Summary
As a product designer, do you trust data when it defies your intuition? What about those times when following data leads you astray? How can you balance the need for experimentation and iteration with the dangers of over-optimization? What are some of the ways that being "data driven" can go wrong? Follow along and learn about the Amplitude design team's journey blending qualitative and quantitative research to drive design strategy—while balancing quality and velocity.
Key Insights
-
•
Data-driven design is on the rise among designers, allowing for better decision-making and product strategy.
-
•
Designers should learn to communicate their work in terms of business outcomes to gain stakeholder buy-in.
-
•
Establishing clear frameworks can help teams define project goals and metrics related to user experience.
-
•
The importance of separating short-term and long-term metrics to allow for both optimization and innovation.
-
•
Blue sky projects should prioritize creative solutions without immediate metric constraints, fostering long-term growth.
-
•
Constantly cross-reference qualitative insights with quantitative metrics for informed decision making.
-
•
Fostering cross-functional relationships with data teams can enhance understanding and collaboration around metrics.
-
•
Visual representation of data can influence interpretation; critical assessment of data presentations is essential.
-
•
Data is a mindset that requires ongoing engagement rather than a one-time effort.
-
•
Balancing between using metrics for performance and understanding the broader user journey is crucial.
Notable Quotes
"It's a great time to be a designer making data-driven design decisions."
"Having user behavior data at your fingertips is a force multiplier for day-to-day decisions."
"Data is a language; learn to speak it effectively to communicate with stakeholders."
"The feedback loop between learning and checking is a process that never ends."
"Over-optimizing for a single metric can leave you with blind spots to bigger user issues."
"Data cannot be the only way of measuring success; it must be integrated into a broader strategy."
"You have to practice connecting better UX outcomes to hard business results."
"Be critical of the data presented; not everything that looks good on a chart is accurate or fair."
"Creating a shared language around metrics can inspire your team to work towards common goals."
"As designers, our role is to articulate how our work ties to larger business objectives."
More Videos
"Designers are mutants, bridging gaps between disciplines."
John MaedaMaking Sense of Enterprise UX
June 9, 2016
"What we want is for organizations to step away from demographics to understand people as cognitive beings."
Indi YoungThinking styles: Mend hidden cracks in your market
January 8, 2025
"Measuring the wrong success indicators can stifle progress and growth."
Chris ChapoData Science and Design: A Tale of Two Tribes
May 13, 2015
"The social dynamics of technology adoption play a critical role."
Elizabeth ChurchillExploring Cadence: You, Your Team, and Your Enterprise
June 8, 2017
"Sharing ideas and unbaked pots is really central to our process."
Rusha SopariwalaRemote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
June 9, 2022
"We mostly have something called BYOE, or bring your own ethics, in the design industry."
George AyeThat Quiet Little Voice: When Design and Ethics Collide
November 16, 2022
"I learned that being in the red for one person was crying and for another, it was complete silence."
Ariba JahanTeam Resiliency Through a Pandemic
January 8, 2024
"This isn’t just about design; this is about enabling clients to succeed."
Julie Gitlin Esther RaiceDesign as an Agent of Digital Transformation at JPMC
June 9, 2021
"We are living in a world made of data and everything that is digital is generating it."
Matteo GrattonCan Data and Ethics Live Together?
October 1, 2021
