Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

But Do Your Insights Scale?
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
But Do Your Insights Scale?
Speakers: Katy Mogal
Link:

Summary

Overcoming stakeholder objections and positioning qualitative data as an input to business and product strategy. When stakeholders have access to real-time data about millions of user interactions, how can qualitative researchers articulate the value of small-sample studies for product and business strategy? In this case study, we’ll show how we used our insights chops to understand stakeholder motivations and concerns, and get qualitative research a seat at the table shaping Google Assistant’s 2020 strategy. We’ll share learnings about how human-centered researchers can effectively collaborate with functions like data science and business strategy, and how to persuade analytically-minded stakeholders to embrace rich qualitative data about people’s needs and motivations as an input to business strategy.

Key Insights

  • Taking calculated risks is essential for qualitative researchers to secure influence in organization-wide strategy discussions.

  • Small qualitative sample sizes can still deliver powerful impactful insights when paired with quantitative data and trust building.

  • Inviting stakeholders to interact directly with unfiltered qualitative data (e.g., video diaries) fosters genuine curiosity and advocacy.

  • Physicalizing data, such as printing quotes and charts in a shared workspace, promotes team engagement and collaborative sensemaking.

  • Converting one respected analyst into a research evangelist can change the conversations and perceptions of entire peer groups.

  • Low-stakes, incremental experiments to share insights reduce resistance and create momentum for organizational change.

  • Qualitative research offers deep understanding of user motivations and needs that quantitative data alone cannot provide.

  • Researchers’ empathy skills are strategic tools to understand and influence stakeholders’ fears, incentives, and motivations.

  • Successful qualitative efforts depend not just on methodology rigor but on bravery, leadership, and cultural positioning.

  • Embedding qualitative insights into yearly planning cycles can shift research from an add-on activity to a core strategy input.

Notable Quotes

"If they don’t give you a seat at the table, bring a folding chair."

"We decided to jump off the wall—that scary leap to prove qualitative insights can change strategy."

"The surveys and logs data tell us the what, but qualitative research tells us the why."

"One converted analyst became our research associate, and his enthusiasm was contagious."

"Getting the data out of laptops and onto the walls made the research physical and accessible."

"It’s not about the methodology, it’s about bravery and leadership."

"Find those curious partners who will evangelize the value of your insights to their peers."

"Researchers are experts at empathy and understanding motivations, which are superpowers beyond just interviewing users."

"Small experiments, planting seeds over time, can shift hearts and minds more effectively than big radical changes."

"Our insights became pillars of the 2020 product strategy and qualitative research earned a reserved seat at the table."

Ask the Rosenbot
Jennifer Bolduc
What's involved with getting people back to work?: A panel discussion
2021 • DesignOps Community
JJ Kercher
A Roadmap for Maturing Design in the Enterprise
2018 • Enterprise Experience 2018
Gold
Dan Willis
Enterprise Storytelling Sessions
2016 • Enterprise UX 2016
Gold
Chris Hammond
Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"
2025 • Climate UX Interest Group
Karen Pascoe
Developing Experience Teams and Talent in the Enterprise
2016 • Enterprise UX 2016
Gold
Daniel Gloyd
Warming the User Experience: Lessons from America's first and most radical human-centered designers
2024 • Rosenfeld Community
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Sarah Brooks
Theme Three Intro
2022 • Civic Design 2022
Gold
Sabrina Mach
How to Design Your Design Operating Model
2021 • DesignOps Summit 2021
Gold
Johnny Michaelsen
Measure Behaviors, Not Results
2026 • Rosenfeld Community
Alana Washington
Theme 1: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Jess Greco
Claiming your power: Practical tools for amplifying your unique voice
2025 • Advancing Research 2025
Gold
Jemma Ahmed
Theme 2 Intro
2024 • Enterprise Experience 2020
Gold
Ricardo Martins
Unlocking the power of advanced quantitative methods
2025 • Advancing Research 2025
Gold
Joshua Graves
We Need To Talk: Addressing Unmet Expectations (Part 2 of 3)
2025 • Rosenfeld Community
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community

More Videos

Louis Rosenfeld

"If your talk isn’t accepted, it doesn’t mean it’s bad—it might just not fit the program’s narrative arc or available slots."

Louis Rosenfeld Jemma Ahmed Christian Crumlish Uday Gajendar Chris Geison

Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?

May 2, 2024

Jilanna Wilson

"Nothing builds collaborative relationships better than being physically present, so we make annual off-sites a priority."

Jilanna Wilson

Distributed Design Operations Management

October 23, 2019

Matt Webb

"The black Buzz Rickson jacket came from a work of fiction by William Gibson and then was made real."

Matt Webb

Context Window: Five Futures for AI

June 11, 2025

Sam Proulx

"Retrofitting accessibility at a later date is difficult, costly, and demoralizing."

Sam Proulx

Accessibility: An Opportunity to Innovate

September 8, 2022

Theresa Neil

"We could become healthcare experts because we actually did have a portfolio in healthcare already."

Theresa Neil

Designing for Wellness: Specializing in Healthcare

May 22, 2024

Peter Van Dijck

"The more I work with evals, the more I think UX and product people need to be involved because of the need for diverse perspectives."

Peter Van Dijck

Hands-on AI #2: Understanding evals: LLM as a Judge

October 15, 2025

Rachel Posman

"Design ops and product ops are way more alike than dissimilar; they differ mainly in the orgs they serve."

Rachel Posman John Calhoun

"Ask Me Anything" with Rachel Posman and John Calhoun, Authors of the Upcoming Rosenfeld Book, The Design Conductors

September 25, 2024

Tricia Wang

"Values conversation is less threatening when framed as wanting to understand why we're doing this project or why we're here."

Tricia Wang

The most popular design thinking strategy is BS

January 27, 2022

Sarah Auslander

"Building trust within organizations toward methods and processes is essential to onboarding new ways of working."

Sarah Auslander Betsy Ramaccia Gordon Ross

Insights Panel

November 18, 2022