Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

But Do Your Insights Scale?
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
But Do Your Insights Scale?
Speakers: Katy Mogal
Link:

Summary

Overcoming stakeholder objections and positioning qualitative data as an input to business and product strategy. When stakeholders have access to real-time data about millions of user interactions, how can qualitative researchers articulate the value of small-sample studies for product and business strategy? In this case study, we’ll show how we used our insights chops to understand stakeholder motivations and concerns, and get qualitative research a seat at the table shaping Google Assistant’s 2020 strategy. We’ll share learnings about how human-centered researchers can effectively collaborate with functions like data science and business strategy, and how to persuade analytically-minded stakeholders to embrace rich qualitative data about people’s needs and motivations as an input to business strategy.

Key Insights

  • Taking calculated risks is essential for qualitative researchers to secure influence in organization-wide strategy discussions.

  • Small qualitative sample sizes can still deliver powerful impactful insights when paired with quantitative data and trust building.

  • Inviting stakeholders to interact directly with unfiltered qualitative data (e.g., video diaries) fosters genuine curiosity and advocacy.

  • Physicalizing data, such as printing quotes and charts in a shared workspace, promotes team engagement and collaborative sensemaking.

  • Converting one respected analyst into a research evangelist can change the conversations and perceptions of entire peer groups.

  • Low-stakes, incremental experiments to share insights reduce resistance and create momentum for organizational change.

  • Qualitative research offers deep understanding of user motivations and needs that quantitative data alone cannot provide.

  • Researchers’ empathy skills are strategic tools to understand and influence stakeholders’ fears, incentives, and motivations.

  • Successful qualitative efforts depend not just on methodology rigor but on bravery, leadership, and cultural positioning.

  • Embedding qualitative insights into yearly planning cycles can shift research from an add-on activity to a core strategy input.

Notable Quotes

"If they don’t give you a seat at the table, bring a folding chair."

"We decided to jump off the wall—that scary leap to prove qualitative insights can change strategy."

"The surveys and logs data tell us the what, but qualitative research tells us the why."

"One converted analyst became our research associate, and his enthusiasm was contagious."

"Getting the data out of laptops and onto the walls made the research physical and accessible."

"It’s not about the methodology, it’s about bravery and leadership."

"Find those curious partners who will evangelize the value of your insights to their peers."

"Researchers are experts at empathy and understanding motivations, which are superpowers beyond just interviewing users."

"Small experiments, planting seeds over time, can shift hearts and minds more effectively than big radical changes."

"Our insights became pillars of the 2020 product strategy and qualitative research earned a reserved seat at the table."

Ask the Rosenbot
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Tatyana Mamut
Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart
2019 • Enterprise Experience 2019
Gold
Ellie Krysl
Planned Right. Managed Right. Designed Right.
2023 • Enterprise UX 2023
Gold
Farid Sabitov
Theme Four Intro
2022 • DesignOps Summit 2022
Gold
Emily Eagle
Can't Rewind: Radio and Retail
2019 • Enterprise Experience 2019
Gold
Sofia Quintero
The Product Philosophy Behind EnjoyHQ
2021 • Advancing Research 2021
Gold
Scott Stephens
The Next Generation in DesignOps Toolsets
2022 • DesignOps Community
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Matt Webb
Context Window: Five Futures for AI
2025 • Designing with AI 2025
Gold
Emily Williams
When UX Research and Institutional Racism Collide: A Case Study
2021 • Advancing Research 2021
Gold
Sha Hwang
The Lost Year
2021 • Design at Scale 2021
Gold
Llewyn Paine
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
2025 • Advancing Research 2025
Gold
Cara Maritz
The Art of Extrapolation
2023 • Advancing Research 2023
Gold
Steve Portigal
Discussion
2015 • Enterprise UX 2015
Gold
Sarah Fathallah
A Typology of Participation in Participatory Research
2023 • Advancing Research 2023
Gold
Brigette Metzler
Scaling ResearchOps: Helping Researchers do Their Best Work
2020 • Advancing Research 2020
Gold

More Videos

Malini Rao

"The curse of hyper-focus means you lose peripheral vision and miss the larger context and customer needs."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021

Katie Hansen

"Meta-analysis is like looking at the average Rotten Tomatoes score to get an overall sentiment from many individual reviews."

Katie Hansen

Finding the unknown in the known: Harnessing meta-analysis and literature review

March 12, 2025

Peter Merholz

"Playing politics is necessary in UX leadership to advance your agenda ethically."

Peter Merholz

The Trials and Tribulations of Directors of UX

July 13, 2023

Maria Rosala

"You cannot just put this 5% of users did not want this without knowing why or where this insight came from."

Maria Rosala Shivanjali M.

Research Repositories

March 12, 2026

Dane DeSutter

"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."

Dane DeSutter

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not

March 26, 2024

Ebru Namaldi

"Design ops is a way to care for the people who design."

Ebru Namaldi

Designing the Designer’s Journey: Scaling Teams, Culture, and Growth Through DesignOps

September 11, 2025

Aaron Stienstra

"Reflecting on our power as implementers of policy, we must reciprocate by giving back information and value to those we engage."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021

Dave Malouf

"Our mantra is tools, not rules. Make it easier for people to do their jobs and they’ll use the design system."

Dave Malouf Amy Thibodeau

Panel: Design Systems and Documentation

November 7, 2017

Scott Plewes

"Math models don’t just provide numerical precision, they can be inspirational for thinking about UX spread."

Scott Plewes

Why Isn't Your UX Approach Going Viral?: A Mathematical Model

March 28, 2023