Rosenverse
But Do Your Insights Scale?

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

But Do Your Insights Scale?

Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
But Do Your Insights Scale?
Speakers: Katy Mogal
Link:

Summary

Overcoming stakeholder objections and positioning qualitative data as an input to business and product strategy. When stakeholders have access to real-time data about millions of user interactions, how can qualitative researchers articulate the value of small-sample studies for product and business strategy? In this case study, we’ll show how we used our insights chops to understand stakeholder motivations and concerns, and get qualitative research a seat at the table shaping Google Assistant’s 2020 strategy. We’ll share learnings about how human-centered researchers can effectively collaborate with functions like data science and business strategy, and how to persuade analytically-minded stakeholders to embrace rich qualitative data about people’s needs and motivations as an input to business strategy.

Key Insights

  • Taking calculated risks is essential for qualitative researchers to secure influence in organization-wide strategy discussions.

  • Small qualitative sample sizes can still deliver powerful impactful insights when paired with quantitative data and trust building.

  • Inviting stakeholders to interact directly with unfiltered qualitative data (e.g., video diaries) fosters genuine curiosity and advocacy.

  • Physicalizing data, such as printing quotes and charts in a shared workspace, promotes team engagement and collaborative sensemaking.

  • Converting one respected analyst into a research evangelist can change the conversations and perceptions of entire peer groups.

  • Low-stakes, incremental experiments to share insights reduce resistance and create momentum for organizational change.

  • Qualitative research offers deep understanding of user motivations and needs that quantitative data alone cannot provide.

  • Researchers’ empathy skills are strategic tools to understand and influence stakeholders’ fears, incentives, and motivations.

  • Successful qualitative efforts depend not just on methodology rigor but on bravery, leadership, and cultural positioning.

  • Embedding qualitative insights into yearly planning cycles can shift research from an add-on activity to a core strategy input.

Notable Quotes

"If they don’t give you a seat at the table, bring a folding chair."

"We decided to jump off the wall—that scary leap to prove qualitative insights can change strategy."

"The surveys and logs data tell us the what, but qualitative research tells us the why."

"One converted analyst became our research associate, and his enthusiasm was contagious."

"Getting the data out of laptops and onto the walls made the research physical and accessible."

"It’s not about the methodology, it’s about bravery and leadership."

"Find those curious partners who will evangelize the value of your insights to their peers."

"Researchers are experts at empathy and understanding motivations, which are superpowers beyond just interviewing users."

"Small experiments, planting seeds over time, can shift hearts and minds more effectively than big radical changes."

"Our insights became pillars of the 2020 product strategy and qualitative research earned a reserved seat at the table."

Ask the Rosenbot
Sarah Gallimore
Inspire Progress with Artifacts from the Future
2022 • Civic Design 2022
Gold
Ana Maria Montero Barrantes
The Authentic UX Talent Show
2024 • Enterprise Experience 2020
Gold
Kwabena Opoku
Methodological toolkit for unique research impact
2026 • Advancing Research 2026
Gold
Bria Alexander
State of DesignOps Panel
2021 • DesignOps Summit 2021
Gold
Greg Petroff
Everything is About to Change: Software as Material
2016 • Enterprise UX 2016
Gold
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Advancing Research 2023
Gold
Maggie Dieringer
Cutting through the Noise
2020 • DesignOps Community
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Alberto Ferreira
Making it Count: Developing a custom digital metric framework that works
2021 • QuantQual Interest Group
Rachel Posman
"Ask Me Anything" with Rachel Posman and John Calhoun, Authors of the Upcoming Rosenfeld Book, The Design Conductors
2024 • DesignOps Summit 2024
Gold
Samuel Proulx
From Standards to Innovation: Why Inclusive Design Wins
2025 • DesignOps Summit 2025
Gold
Erika Flowers
The Handoff is Dead: Design-Led Engineering with AI Agents
2026 • Rosenfeld Community
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Jack Moffett
SAFe or Sorry?
2019 • Enterprise Community
Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold

More Videos

Sarah Barrett

"No amount of power is enough to make a wide-ranging agenda move forward on its own."

Sarah Barrett

The "How" of Enterprise Information Architecture

June 6, 2023

Catt Small

"Visions capture held knowledge that a team has maybe not been able to yet take action on."

Catt Small

Craft a Vision that Actually Gets Shipped

April 30, 2026

Dave Hoffer

"If you don’t have any work, make some spec work just to show your skills."

Dave Hoffer Joanne Weaver

UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer

April 3, 2025

Jane Davis

"Democratization of research is not just about scaling capacity but about fostering collaboration."

Jane Davis

Strategic Shifts and Innovations in User Research: Navigating Challenges and Opportunities

March 11, 2025

Rachael Dietkus, LCSW

"Nothing is inherently better because it was produced by human intention or machine learning; interrogate the goal first."

Rachael Dietkus, LCSW Llewyn Paine Nishanshi Shukla David Womack

AI: Passionate defenses and reasoned critique [Advancing Research Community Workshop Series]

September 18, 2024

Maria Skaaden

"I am uncomfortable too. Change is uncomfortable, exhausting, but it can also be fun and exciting."

Maria Skaaden

Panel Discussion: Methodologies and Work Environments

November 8, 2018

Cheryl Platz

"Customers move from one device to another often because the information density or proximity to the device changes."

Cheryl Platz

Demystifying Multimodal Design: The Design Practice You Didn't Know You're Doing

April 4, 2024

Ron Bronson

"I’m just trying to get the kid a coat, I don’t need it on my resume."

Ron Bronson

Design, Consequences & Everyday Life

November 18, 2022

Liam Thurston

"Soft skills often are a multiplier on your hard skills—they’re just as valuable, if not more so."

Liam Thurston

Why Your Design Team Is Quitting, And How To Fix It

June 10, 2022