Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Knowing how to solve the right problem is only one small part of the product-success equation. And nailing the execution is harder than most people think. As Erin says in this talk, “There are far more ways to fail than there are to succeed” when it comes to experimentation. To help you learn, Erin shares some of the silly mistakes she made while A/B testing her designs. That way you can avoid those pitfalls as you work to make your digital product better—not just different.
Key Insights
-
•
Over 90% of A/B tests at Booking.com fail, emphasizing the need for rigorous testing.
-
•
The execution often matters more than the idea itself in determining success.
-
•
A culture of experimentation leads to better user experiences and business growth.
-
•
Understanding user behavior is crucial for designing effective tests and features.
-
•
Small changes in design can significantly impact user experience and conversion rates.
-
•
Continuous re-evaluation of experiments is essential as technology and consumer behavior evolve.
-
•
Qualitative feedback should complement quantitative metrics to understand user interactions better.
-
•
Design choices, such as font selection, can have unexpected effects on clarity and conversion.
-
•
Edge cases in user experience can lead to significant issues in usability and conversion.
-
•
Investing in tracking and analytics tools enhances the ability to gather useful data for informed decision-making.
Notable Quotes
"I'm actually a really big failure."
"About 90% of all the work that I did for booking.com ended up in the garbage can."
"If a problem presents itself over and over again, it's not necessarily the concept that fails."
"The invisible decisions we make can impact a customer's experience as much as what they see on the screen."
"Typography matters. It matters a lot."
"Good design often lies between what's already there and what we think is best."
"We democratized user research. The researchers were there to enable us to do our own research."
"You can't fail 90 times out of 10 without finding humor in it."
"If you don’t need to, just don’t use fancy typefaces."
"A little line of CSS that may have made a browser crash last year might not make a browser crash anymore."
More Videos
"It's essential to approach service design from a holistic system perspective, considering all interdependencies."
Ed MullenDesigning the Unseen: Enabling Institutions to Build Public Trust
November 16, 2022
"I think the most effective strategic research we can do is work that provides an occasion for expanding our organization's fields of future possibility."
Peter LevinSolve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility
March 25, 2024
"We have been meeting every month for a few years now."
Bria Alexander Benson Low Natalya Pemberton Stephanie GoldthorpeOKRs—Helpful or Harmful?
January 20, 2022
"This power of telepathy has enabled proactive solutions like expanded resource capacity planning"
Kate Koch Prateek KalliFlex Your Super Powers: When a Design Ops Team Scales to Power CX
September 30, 2021
"Making your chief legal officer your best friend as a designer makes sense."
Amy MarquezINVEST: Discussion
June 15, 2018
"If we design teams based solely on what we know today, we'll miss out on creating a better tomorrow."
Brenna FallonLearning Over Outcomes
October 24, 2019
"Thanks for taking the time to come along today."
Brian MossWhat Does it Mean to be a Resilient Research Team?
March 9, 2022
"This is what we believe the priorities are from what you've told us – now can you help us rank that?"
Adel Du ToitGet Your CFO To Say: 'Our Strategic Goal is User Obsession'
June 10, 2022
"We've layered in capabilities for design like impact assessments and accelerated resource planning."
Kate Koch Jean-Claire FitschenFlex Your Super Powers: When a Design Ops Team Scales to Power CX
September 29, 2021
