Summary
As a product designer, do you trust data when it defies your intuition? What about those times when following data leads you astray? How can you balance the need for experimentation and iteration with the dangers of over-optimization? What are some of the ways that being "data driven" can go wrong? Follow along and learn about the Amplitude design team's journey blending qualitative and quantitative research to drive design strategy—while balancing quality and velocity.
Key Insights
-
•
Data-driven design is on the rise among designers, allowing for better decision-making and product strategy.
-
•
Designers should learn to communicate their work in terms of business outcomes to gain stakeholder buy-in.
-
•
Establishing clear frameworks can help teams define project goals and metrics related to user experience.
-
•
The importance of separating short-term and long-term metrics to allow for both optimization and innovation.
-
•
Blue sky projects should prioritize creative solutions without immediate metric constraints, fostering long-term growth.
-
•
Constantly cross-reference qualitative insights with quantitative metrics for informed decision making.
-
•
Fostering cross-functional relationships with data teams can enhance understanding and collaboration around metrics.
-
•
Visual representation of data can influence interpretation; critical assessment of data presentations is essential.
-
•
Data is a mindset that requires ongoing engagement rather than a one-time effort.
-
•
Balancing between using metrics for performance and understanding the broader user journey is crucial.
Notable Quotes
"It's a great time to be a designer making data-driven design decisions."
"Having user behavior data at your fingertips is a force multiplier for day-to-day decisions."
"Data is a language; learn to speak it effectively to communicate with stakeholders."
"The feedback loop between learning and checking is a process that never ends."
"Over-optimizing for a single metric can leave you with blind spots to bigger user issues."
"Data cannot be the only way of measuring success; it must be integrated into a broader strategy."
"You have to practice connecting better UX outcomes to hard business results."
"Be critical of the data presented; not everything that looks good on a chart is accurate or fair."
"Creating a shared language around metrics can inspire your team to work towards common goals."
"As designers, our role is to articulate how our work ties to larger business objectives."
















More Videos

"Designing services that work not just for us now but for our future selves is our responsibility."
Samuel ProulxInvisible barriers: Why accessible service design can’t be an afterthought
December 3, 2024

"Live, listen, laugh, and learn while being open to transformation."
Victor UdoewaTheme One Intro
March 27, 2023

"We as design leaders work a lot on levels one, two, and three, but sometimes we forget the most important alignment with the company strategy."
Gonzalo GoyanesDesign ROI: Cover a Little, Get a Lot
September 8, 2022

"Designers need to understand the role of policy to address technology harms effectively."
Alexandra SchmidtWhy Ethics Can't Save Tech
November 18, 2022

"Results don't speak for themselves; we speak for what we do."
Jose CoronadoFrom Zero to Hero
September 8, 2022

"Imagine the good we can do if we can reach more people."
Pippa LomasPaving the Path for Neurodiversity in Design
October 4, 2023

"This is a new space that we are all trying to figure out together."
Louis Rosenfeld Matt Jones Olga Khroustaleva Michael Leggett Karol MunozDo you want to work on climate? (Climate UX Discussion Series)
November 15, 2023

"A designer juggling multiple teams has to decide which two people am I going to piss off today."
Jeff GothelfThe Intersection of Lean and Design
January 10, 2019

"Once you get into the conversation, things are going to occur to you."
Dave GrayGroup Activity: Making Sense of DesignOps
November 7, 2017