Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

But Do Your Insights Scale?
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
But Do Your Insights Scale?
Speakers: Katy Mogal
Link:

Summary

Overcoming stakeholder objections and positioning qualitative data as an input to business and product strategy. When stakeholders have access to real-time data about millions of user interactions, how can qualitative researchers articulate the value of small-sample studies for product and business strategy? In this case study, we’ll show how we used our insights chops to understand stakeholder motivations and concerns, and get qualitative research a seat at the table shaping Google Assistant’s 2020 strategy. We’ll share learnings about how human-centered researchers can effectively collaborate with functions like data science and business strategy, and how to persuade analytically-minded stakeholders to embrace rich qualitative data about people’s needs and motivations as an input to business strategy.

Key Insights

  • Taking calculated risks is essential for qualitative researchers to secure influence in organization-wide strategy discussions.

  • Small qualitative sample sizes can still deliver powerful impactful insights when paired with quantitative data and trust building.

  • Inviting stakeholders to interact directly with unfiltered qualitative data (e.g., video diaries) fosters genuine curiosity and advocacy.

  • Physicalizing data, such as printing quotes and charts in a shared workspace, promotes team engagement and collaborative sensemaking.

  • Converting one respected analyst into a research evangelist can change the conversations and perceptions of entire peer groups.

  • Low-stakes, incremental experiments to share insights reduce resistance and create momentum for organizational change.

  • Qualitative research offers deep understanding of user motivations and needs that quantitative data alone cannot provide.

  • Researchers’ empathy skills are strategic tools to understand and influence stakeholders’ fears, incentives, and motivations.

  • Successful qualitative efforts depend not just on methodology rigor but on bravery, leadership, and cultural positioning.

  • Embedding qualitative insights into yearly planning cycles can shift research from an add-on activity to a core strategy input.

Notable Quotes

"If they don’t give you a seat at the table, bring a folding chair."

"We decided to jump off the wall—that scary leap to prove qualitative insights can change strategy."

"The surveys and logs data tell us the what, but qualitative research tells us the why."

"One converted analyst became our research associate, and his enthusiasm was contagious."

"Getting the data out of laptops and onto the walls made the research physical and accessible."

"It’s not about the methodology, it’s about bravery and leadership."

"Find those curious partners who will evangelize the value of your insights to their peers."

"Researchers are experts at empathy and understanding motivations, which are superpowers beyond just interviewing users."

"Small experiments, planting seeds over time, can shift hearts and minds more effectively than big radical changes."

"Our insights became pillars of the 2020 product strategy and qualitative research earned a reserved seat at the table."

Ask the Rosenbot
Nicole Aleong
Future Orientations to Everyday Life: Futures Anthropology as a Methodology
2024 • Advancing Research 2024
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 2: Evals are your moat
2025 • Rosenfeld Community
Etienne Fang
The Power of Care: From Human-Centered Research to Humanity-Centered Leadership
2021 • Advancing Research 2021
Gold
Dave Hora
Research in the Face of Complexity: New Sensibility for New Situations
2025 • Rosenfeld Community
John Taschek
Making People the X-Factor in the Enterprise
2018 • Enterprise Experience 2018
Gold
Indi Young
Paying Better Attention to the Problem with Indi Young
2019 • Advancing Research Community
Michael Weir
Mixed Methods and Behavioural Science
2023 • Rosenfeld Community
Victor Udoewa
Research in the Pluriverse
2023 • Advancing Research 2023
Gold
Amy Jiménez Márquez
The Atypical UX Manager Path
2020 • Enterprise Community
Dan Hill
Designing for the infrastructures of everyday life
2024 • Designing with AI 2024
Gold
Sarah Fathallah
A Typology of Participation in Participatory Research
2023 • Advancing Research 2023
Gold
Christian Rohrer
Insight Types That Influence Enterprise Decision Makers
2015 • Enterprise UX 2015
Gold
Dane DeSutter
Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries
2024 • QuantQual Interest Group
Alana Washington
(Remote) Service Design: A Transformation Case Study
2022 • Design at Scale 2022
Gold
Mitchell Bernstein
Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape
2021 • DesignOps Summit 2021
Gold
Raven Veal
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
2021 • Advancing Research 2021
Gold

More Videos

Sam Proulx

"Screen reader users scored significantly lower in usability tests, reflecting the most effort in interpreting content."

Sam Proulx

SUS: A System Unusable for Twenty Percent of the Population

December 9, 2021

Michael Land

"There are lots of little mushroom patches of design sprouting up, but they're disconnected and not sharing."

Michael Land

Establishing Design Operations in Government

February 18, 2021

Shipra Kayan

"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."

Shipra Kayan

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

September 30, 2021

Ian Swinson

"If you’re amazing at your job but no one listens to your research or design, does it really have impact?"

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Isaac Heyveld

"The chief of staff is the bridge between our executive leadership team and the design ops practitioners."

Isaac Heyveld

Expand DesignOps Leadership as a Chief of Staff

September 8, 2022

Amy Evans

"We categorized all our work into may-do, must-do, and desire-to-do buckets to better allocate our efforts."

Amy Evans

How to Create Change

September 25, 2024

Kate Koch

"Super strength is the resilience and endurance to partner and drive strategic impact backed by customer obsession."

Kate Koch Prateek Kalli

Flex Your Super Powers: When a Design Ops Team Scales to Power CX

September 30, 2021

Dave Gray

"If you do anything with other people, you’re creating culture."

Dave Gray

Liminal Thinking: Sense-making for systems in large organizations

May 14, 2015

Matt Duignan

"Curation is super important, but also super hard."

Matt Duignan

Atomizing Research: Trend or Trap

March 30, 2020