Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Did you know that you're probably designing multimodal experiences? Most designers today are working in a multimodal environment, but haven't been trained to make the most of the many capabilities the latest generations of devices provide. Your customers have a small universe of devices, and they now come with the ability to handle far more than traditional haptic input like keyboards and mice. Gestural input, from swipes to hand gestures in video calls to stylus input, is becoming more common. Audio input and output are becoming more important in a world where digital assistants are poised to make a second surge powered by large language model AI. Visual output has become much more nuanced, and sometimes spans multiple devices. How do you wrangle all of this, optimize for great experiences, and still keep the human at the center? By becoming more consciously aware of the different inputs and outputs we're working with - and the many ways these inputs and outputs include and exclude our customers - we can build more resilient, more inclusive, and more powerful next-generation experiences.
Key Insights
-
•
Multimodal design is often an unrecognized practice in the design community, but most designers already incorporate aspects of it.
-
•
Human communication is inherently multimodal, and the future of design must mirror this complexity.
-
•
Understanding client context, including environmental factors and user relationships, is essential for creating effective designs.
-
•
Designing for multiple devices requires careful attention to transitions between modalities, which can significantly impact user experience.
-
•
Proactive communication during transitions enhances user satisfaction and prevents confusion during device handoffs.
-
•
Not all users interact with devices in the same way; tailoring experiences to different contexts is key to engagement.
-
•
Designs must accommodate both high and low information density, as well as proximity to users, to ensure seamless interaction.
-
•
Incorporating user research, including diary studies and guided tours, can reveal nuanced insights into multimodal usage.
-
•
Stakeholder buy-in for multimodal design should be linked to business goals like accessibility improvements and enhanced user engagement.
-
•
Emerging technologies will continue to shape the landscape of multimodal design, allowing for even richer interactions.
Notable Quotes
"The future is multimodal because humans are multimodal."
"Multimodal design is the design practice you probably don't realize you're doing."
"Understanding your customer's context is critical to your success."
"If a customer has come with a goal and you put something in their way, that's when you lose them."
"Proactive communication is critical to customer comfort and preventing tickets and freakouts."
"If we fully understand both design spaces, we truly empower ourselves to create resilient experiences."
"A mode in this context is a type of communication—primarily using senses."
"The practice adds an additional layer of design rigor on top of our existing modality-specific designs."
"Customers are swimming in devices now, and even websites are cross device."
"Design Beyond Devices gives you a complete toolkit for working at the cutting edge."
More Videos
"Money is not an evil thing."
John MaedaMaking Sense of Enterprise UX
June 9, 2016
"It’s essential to approach thinking styles without prior demographic assumptions."
Indi YoungThinking styles: Mend hidden cracks in your market
January 8, 2025
"Data scientists are sometimes thought of as the golden unicorns who can solve anything."
Chris ChapoData Science and Design: A Tale of Two Tribes
May 13, 2015
"Material design is a framework for creating web and mobile experiences."
Elizabeth ChurchillExploring Cadence: You, Your Team, and Your Enterprise
June 8, 2017
"Collectives are communities of practice individuals that have an interest in a particular topic."
Rusha SopariwalaRemote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
June 9, 2022
"What if we could have a system of accountability that includes a code of ethics?"
George AyeThat Quiet Little Voice: When Design and Ethics Collide
November 16, 2022
"We need to normalize video off for our meetings when people need a break from being on camera all day."
Ariba JahanTeam Resiliency Through a Pandemic
January 8, 2024
"Getting to know your stakeholders helps foster collaboration and understanding."
Julie Gitlin Esther RaiceDesign as an Agent of Digital Transformation at JPMC
June 9, 2021
"Ethical decisions will change over time; they're not static."
Matteo GrattonCan Data and Ethics Live Together?
October 1, 2021
