Summary
As a product designer, do you trust data when it defies your intuition? What about those times when following data leads you astray? How can you balance the need for experimentation and iteration with the dangers of over-optimization? What are some of the ways that being "data driven" can go wrong? Follow along and learn about the Amplitude design team's journey blending qualitative and quantitative research to drive design strategy—while balancing quality and velocity.
Key Insights
-
•
Data-driven design is on the rise among designers, allowing for better decision-making and product strategy.
-
•
Designers should learn to communicate their work in terms of business outcomes to gain stakeholder buy-in.
-
•
Establishing clear frameworks can help teams define project goals and metrics related to user experience.
-
•
The importance of separating short-term and long-term metrics to allow for both optimization and innovation.
-
•
Blue sky projects should prioritize creative solutions without immediate metric constraints, fostering long-term growth.
-
•
Constantly cross-reference qualitative insights with quantitative metrics for informed decision making.
-
•
Fostering cross-functional relationships with data teams can enhance understanding and collaboration around metrics.
-
•
Visual representation of data can influence interpretation; critical assessment of data presentations is essential.
-
•
Data is a mindset that requires ongoing engagement rather than a one-time effort.
-
•
Balancing between using metrics for performance and understanding the broader user journey is crucial.
Notable Quotes
"It's a great time to be a designer making data-driven design decisions."
"Having user behavior data at your fingertips is a force multiplier for day-to-day decisions."
"Data is a language; learn to speak it effectively to communicate with stakeholders."
"The feedback loop between learning and checking is a process that never ends."
"Over-optimizing for a single metric can leave you with blind spots to bigger user issues."
"Data cannot be the only way of measuring success; it must be integrated into a broader strategy."
"You have to practice connecting better UX outcomes to hard business results."
"Be critical of the data presented; not everything that looks good on a chart is accurate or fair."
"Creating a shared language around metrics can inspire your team to work towards common goals."
"As designers, our role is to articulate how our work ties to larger business objectives."
More Videos
"You have not lost your rights, you don't lose your humanity."
Sahibzada MayedThe Politics of Radical Research: A Manifesto
March 27, 2023
"Even when teams want research, they may not realize that they have to change how they operate to make use of your work."
Dave HoraAdvice for Establishing Research
December 8, 2022
"Don't hide away for six months trying to build the perfect documentation."
Gabrielle VerderberDocumentation Your Team Will Actually Use
October 3, 2023
"Raising awareness around dark metrics is essential for user advocacy."
Raven VealDark Metrics: Illuminating the Negative Impact of Digital Health Design
March 12, 2021
"Delivery is a must. There's no failure, it's not an option."
Gretchen AndersonScaling the Human Center
June 8, 2017
"If you're tweaking words repeatedly, you likely have a UI problem, not a content problem."
Craig Brookes Andreas Huebner Morgan Quinn"Just Make it Look Good" and Other Ways We're Misunderstood
June 11, 2021
"The partnerships we established significantly amplified the outcomes of our initiatives."
Sarah AuslanderIncremental Steps to Drive Radical Innovation in Policy Design
November 18, 2022
"The success of any framework is in its ability to scale sustainably."
Joe Meersman Pooria SohiUse AI to Drive Outcomes that Go Beyond the Design Sprint
September 25, 2024
"To scale what we've achieved, we must ensure our design system is accessible by default."
Saara Kamppari-MillerInclusive Design is DesignOps
September 29, 2021
