Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

But Do Your Insights Scale?
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
But Do Your Insights Scale?
Speakers: Katy Mogal
Link:

Summary

Overcoming stakeholder objections and positioning qualitative data as an input to business and product strategy. When stakeholders have access to real-time data about millions of user interactions, how can qualitative researchers articulate the value of small-sample studies for product and business strategy? In this case study, we’ll show how we used our insights chops to understand stakeholder motivations and concerns, and get qualitative research a seat at the table shaping Google Assistant’s 2020 strategy. We’ll share learnings about how human-centered researchers can effectively collaborate with functions like data science and business strategy, and how to persuade analytically-minded stakeholders to embrace rich qualitative data about people’s needs and motivations as an input to business strategy.

Key Insights

  • Taking calculated risks is essential for qualitative researchers to secure influence in organization-wide strategy discussions.

  • Small qualitative sample sizes can still deliver powerful impactful insights when paired with quantitative data and trust building.

  • Inviting stakeholders to interact directly with unfiltered qualitative data (e.g., video diaries) fosters genuine curiosity and advocacy.

  • Physicalizing data, such as printing quotes and charts in a shared workspace, promotes team engagement and collaborative sensemaking.

  • Converting one respected analyst into a research evangelist can change the conversations and perceptions of entire peer groups.

  • Low-stakes, incremental experiments to share insights reduce resistance and create momentum for organizational change.

  • Qualitative research offers deep understanding of user motivations and needs that quantitative data alone cannot provide.

  • Researchers’ empathy skills are strategic tools to understand and influence stakeholders’ fears, incentives, and motivations.

  • Successful qualitative efforts depend not just on methodology rigor but on bravery, leadership, and cultural positioning.

  • Embedding qualitative insights into yearly planning cycles can shift research from an add-on activity to a core strategy input.

Notable Quotes

"If they don’t give you a seat at the table, bring a folding chair."

"We decided to jump off the wall—that scary leap to prove qualitative insights can change strategy."

"The surveys and logs data tell us the what, but qualitative research tells us the why."

"One converted analyst became our research associate, and his enthusiasm was contagious."

"Getting the data out of laptops and onto the walls made the research physical and accessible."

"It’s not about the methodology, it’s about bravery and leadership."

"Find those curious partners who will evangelize the value of your insights to their peers."

"Researchers are experts at empathy and understanding motivations, which are superpowers beyond just interviewing users."

"Small experiments, planting seeds over time, can shift hearts and minds more effectively than big radical changes."

"Our insights became pillars of the 2020 product strategy and qualitative research earned a reserved seat at the table."

Ask the Rosenbot
Rachael Dietkus, LCSW
The power to heal and harm
2025 • Advancing Research 2025
Gold
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2019 • Enterprise Experience 2019
Gold
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
Christian Rohrer
Insight Types That Influence Enterprise Decision Makers
2015 • Enterprise UX 2015
Gold
Edgar Anzaldua Moreno
Using Research to Determine Unique Value Proposition
2021 • Advancing Research 2021
Gold
Wendy Johansson
Be a Product Boss!
2022 • Design in Product 2022
Gold
Sarah Auslander
Incremental Steps to Drive Radical Innovation in Policy Design
2022 • Civic Design 2022
Gold
Dave Hora
Advice for Establishing Research
2022 • Advancing Research Community
Dan Hill
Strategic design, slowdown, and the infrastructures of everyday life
2022 • Enterprise Community
Andrew Michael
Building a Product Insights Team
2022 • Advancing Research 2022
Gold
Lada Gorlenko
Theme 3: Introduction
2021 • Design at Scale 2021
Gold
Brenna Fallon
Learning Over Outcomes
2019 • DesignOps Summit 2019
Gold
Emily Williams
When UX Research and Institutional Racism Collide: A Case Study
2021 • Advancing Research 2021
Gold
Bria Alexander
Opening Remarks
2023 • Advancing Research 2023
Gold
Louis Rosenfeld
Opening Remarks
2023 • Design in Product 2023
Gold
Jon White
Unsticking Research for Better Information Flow
2026 • Advancing Research 2026
Conference

More Videos

Milan Guenther

"We often don’t prototype everything ourselves; instead, we role play with client team members to simulate complex organizational aspects."

Milan Guenther Benjamin Kumpf

The $212 billion ‘so what?’: unlocking impact in development cooperation

November 20, 2025

Alnie Figueroa

"Our job is really a lot of managing ambiguity and chaos. It’s just par for the course because a lot of that we do is in the explore and design phase."

Alnie Figueroa

Teamwork: Strategies for Effective Collaboration with Other Program Management Teams

September 8, 2022

Saara Kamppari-Miller

"The canary in the coal mine—that’s how we identify the fail points in the user experience we absolutely can’t miss."

Saara Kamppari-Miller Nicole Bergstrom Shashi Jain

Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”

November 13, 2024

Christian Crumlish

"I myself career-wise went over to the dark side and became a product manager."

Christian Crumlish

Introduction by our Conference Chair

December 6, 2022

Helen Armstrong

"The relationship between designers and data scientists can actually be pretty magical."

Helen Armstrong

Augment the Human. Interrogate the System.

June 7, 2023

Verónica Urzúa

"We need to break the dream and move from spectators to actors who create knowledge grounded in our reality."

Verónica Urzúa Jorge Montiel

The B-side of the Research Impact

March 12, 2021

Yoel Sumitro

"Researchers were obsessed with scientific rigor while designers used balance, feelings, or intuition as their rigor."

Yoel Sumitro

Actions and Reflections: Bridging the Skills Gap among Researchers

March 9, 2022

Jim Kalbach

"Miles gave them the music as they entered the studio; they didn’t know what they were going to be playing."

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

June 4, 2019

Bud Caddell

"This conference is a polished snapshot of conversations already happening at scale in the community."

Bud Caddell Kristin Skinner Alana Washington

DesignOps Community Sensing Session

May 13, 2021