Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Did you know that you're probably designing multimodal experiences? Most designers today are working in a multimodal environment, but haven't been trained to make the most of the many capabilities the latest generations of devices provide. Your customers have a small universe of devices, and they now come with the ability to handle far more than traditional haptic input like keyboards and mice. Gestural input, from swipes to hand gestures in video calls to stylus input, is becoming more common. Audio input and output are becoming more important in a world where digital assistants are poised to make a second surge powered by large language model AI. Visual output has become much more nuanced, and sometimes spans multiple devices. How do you wrangle all of this, optimize for great experiences, and still keep the human at the center? By becoming more consciously aware of the different inputs and outputs we're working with - and the many ways these inputs and outputs include and exclude our customers - we can build more resilient, more inclusive, and more powerful next-generation experiences.
Key Insights
-
•
Multimodal design is often an unrecognized practice in the design community, but most designers already incorporate aspects of it.
-
•
Human communication is inherently multimodal, and the future of design must mirror this complexity.
-
•
Understanding client context, including environmental factors and user relationships, is essential for creating effective designs.
-
•
Designing for multiple devices requires careful attention to transitions between modalities, which can significantly impact user experience.
-
•
Proactive communication during transitions enhances user satisfaction and prevents confusion during device handoffs.
-
•
Not all users interact with devices in the same way; tailoring experiences to different contexts is key to engagement.
-
•
Designs must accommodate both high and low information density, as well as proximity to users, to ensure seamless interaction.
-
•
Incorporating user research, including diary studies and guided tours, can reveal nuanced insights into multimodal usage.
-
•
Stakeholder buy-in for multimodal design should be linked to business goals like accessibility improvements and enhanced user engagement.
-
•
Emerging technologies will continue to shape the landscape of multimodal design, allowing for even richer interactions.
Notable Quotes
"The future is multimodal because humans are multimodal."
"Multimodal design is the design practice you probably don't realize you're doing."
"Understanding your customer's context is critical to your success."
"If a customer has come with a goal and you put something in their way, that's when you lose them."
"Proactive communication is critical to customer comfort and preventing tickets and freakouts."
"If we fully understand both design spaces, we truly empower ourselves to create resilient experiences."
"A mode in this context is a type of communication—primarily using senses."
"The practice adds an additional layer of design rigor on top of our existing modality-specific designs."
"Customers are swimming in devices now, and even websites are cross device."
"Design Beyond Devices gives you a complete toolkit for working at the cutting edge."
More Videos
"Disability is a normal part of the human experience"
Sam ProulxAccessibility: An Opportunity to Innovate
November 16, 2022
"It's not just the engineers doing technical things all day; designers need to be technical too."
Mike DavidsonFireside Chat
March 11, 2022
"If you go on skepticism, you probably won’t find great people."
Husani OakleyBias Towards Action: Building Teams that Build Work
June 14, 2018
"Our benchmarking study was our first shot at quantifying the user experience."
JD BuckleyCommunicating the ROI of UX within a large enterprise and out on the streets
June 14, 2018
"We're at a Rosenfeld Media conference on enterprise UX. Isn't life strange?"
Louis RosenfeldWelcome / Housekeeping
June 6, 2023
"We shouldn't settle for good enough or justify poor performance."
Brendan JarvisFraming Tomorrow by Questioning Today
June 8, 2022
"Designers need to learn to work in partnership with AI, treating it as an active collaborator."
Josh Clark Veronika KindredSentient Design, AI, and the Radically Adaptive Experience (1st of 3 seminars)
January 15, 2025
"UX online benchmarking provides a fast and efficient way to help our clients identify the strengths and weaknesses of their products."
Daniela Magaña Flores Ariane Rahn Jeff Ephraim BanderAhead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
March 10, 2022
"I felt on edge and physically depleted after our interactions."
Darian DavisLessons from a Toxic Work Relationship
January 8, 2024
