Summary
As a product designer, do you trust data when it defies your intuition? What about those times when following data leads you astray? How can you balance the need for experimentation and iteration with the dangers of over-optimization? What are some of the ways that being "data driven" can go wrong? Follow along and learn about the Amplitude design team's journey blending qualitative and quantitative research to drive design strategy—while balancing quality and velocity.
Key Insights
-
•
Data-driven design is on the rise among designers, allowing for better decision-making and product strategy.
-
•
Designers should learn to communicate their work in terms of business outcomes to gain stakeholder buy-in.
-
•
Establishing clear frameworks can help teams define project goals and metrics related to user experience.
-
•
The importance of separating short-term and long-term metrics to allow for both optimization and innovation.
-
•
Blue sky projects should prioritize creative solutions without immediate metric constraints, fostering long-term growth.
-
•
Constantly cross-reference qualitative insights with quantitative metrics for informed decision making.
-
•
Fostering cross-functional relationships with data teams can enhance understanding and collaboration around metrics.
-
•
Visual representation of data can influence interpretation; critical assessment of data presentations is essential.
-
•
Data is a mindset that requires ongoing engagement rather than a one-time effort.
-
•
Balancing between using metrics for performance and understanding the broader user journey is crucial.
Notable Quotes
"It's a great time to be a designer making data-driven design decisions."
"Having user behavior data at your fingertips is a force multiplier for day-to-day decisions."
"Data is a language; learn to speak it effectively to communicate with stakeholders."
"The feedback loop between learning and checking is a process that never ends."
"Over-optimizing for a single metric can leave you with blind spots to bigger user issues."
"Data cannot be the only way of measuring success; it must be integrated into a broader strategy."
"You have to practice connecting better UX outcomes to hard business results."
"Be critical of the data presented; not everything that looks good on a chart is accurate or fair."
"Creating a shared language around metrics can inspire your team to work towards common goals."
"As designers, our role is to articulate how our work ties to larger business objectives."
More Videos
"The very innovation you may need might already be written."
Jacqui FreyFlow and Superfluidity for Design Orgs
November 7, 2018
"To foster engagement, using emojis and gifs can add the tone and body language that are often missed in text."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024
"Insights are unexpected discoveries about how things work and how to make them work better."
Johanna KollmannInsights-Driven Product Strategy: Get your Research to Count
December 6, 2022
"We will absolutely promise to let you know when these resources are available for you to enjoy."
Bria AlexanderDay 3 Welcome
September 25, 2024
"When you explore lots of different ideas, you're going to understand the context better."
Billy CarlsonIdeation tips for Product Managers
December 6, 2022
"When expectations are low for process, it’s the perfect opportunity to rifle through new approaches."
Catherine DubutBridging Physical and Digital Spaces: Approaches to Retail Service Design
March 18, 2021
"Trust is the foundation of our team's culture and needs to be maintained during changes."
Kim Holt Emma Wylds Pearl Koppenhaver Maisee XiongA Salesforce Panel Discussion on Values-Driven DesignOps
September 8, 2022
"The best practitioners see a biased view of their community's ability."
Adrian HowardSturgeon’s Biases
September 25, 2024
"It's important to assume positive intent."
Asia HoePartnering with Product: A Journey from Junior to Senior Design
November 29, 2023
