Rosenverse
But Do Your Insights Scale?

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

But Do Your Insights Scale?

Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
But Do Your Insights Scale?
Speakers: Katy Mogal
Link:

Summary

Overcoming stakeholder objections and positioning qualitative data as an input to business and product strategy. When stakeholders have access to real-time data about millions of user interactions, how can qualitative researchers articulate the value of small-sample studies for product and business strategy? In this case study, we’ll show how we used our insights chops to understand stakeholder motivations and concerns, and get qualitative research a seat at the table shaping Google Assistant’s 2020 strategy. We’ll share learnings about how human-centered researchers can effectively collaborate with functions like data science and business strategy, and how to persuade analytically-minded stakeholders to embrace rich qualitative data about people’s needs and motivations as an input to business strategy.

Key Insights

  • •

    Taking calculated risks is essential for qualitative researchers to secure influence in organization-wide strategy discussions.

  • •

    Small qualitative sample sizes can still deliver powerful impactful insights when paired with quantitative data and trust building.

  • •

    Inviting stakeholders to interact directly with unfiltered qualitative data (e.g., video diaries) fosters genuine curiosity and advocacy.

  • •

    Physicalizing data, such as printing quotes and charts in a shared workspace, promotes team engagement and collaborative sensemaking.

  • •

    Converting one respected analyst into a research evangelist can change the conversations and perceptions of entire peer groups.

  • •

    Low-stakes, incremental experiments to share insights reduce resistance and create momentum for organizational change.

  • •

    Qualitative research offers deep understanding of user motivations and needs that quantitative data alone cannot provide.

  • •

    Researchers’ empathy skills are strategic tools to understand and influence stakeholders’ fears, incentives, and motivations.

  • •

    Successful qualitative efforts depend not just on methodology rigor but on bravery, leadership, and cultural positioning.

  • •

    Embedding qualitative insights into yearly planning cycles can shift research from an add-on activity to a core strategy input.

Notable Quotes

"If they don’t give you a seat at the table, bring a folding chair."

"We decided to jump off the wall—that scary leap to prove qualitative insights can change strategy."

"The surveys and logs data tell us the what, but qualitative research tells us the why."

"One converted analyst became our research associate, and his enthusiasm was contagious."

"Getting the data out of laptops and onto the walls made the research physical and accessible."

"It’s not about the methodology, it’s about bravery and leadership."

"Find those curious partners who will evangelize the value of your insights to their peers."

"Researchers are experts at empathy and understanding motivations, which are superpowers beyond just interviewing users."

"Small experiments, planting seeds over time, can shift hearts and minds more effectively than big radical changes."

"Our insights became pillars of the 2020 product strategy and qualitative research earned a reserved seat at the table."

Ask the Rosenbot
George Abraham
Design Systems To-Go: Introducing a Starter Design System, and Indigo.Design Overview (Part 1)
2021 • DesignOps Summit 2021
Gold
Greg Petroff
Exit Interview #1: Greg Petroff: From Silicon Valley Executive to Sonoma County Possibilitarian
2025 • Rosenfeld Community
Alla Weinberg
Design Teams Need Psychological Safety: Here’s How to Create It
2022 • DesignOps Summit 2022
Gold
Rachel Garb
Exit Interview #8: Facing a blank slate in retirement when constraints are all you’ve ever known
2026 • Rosenfeld Community
Sofia Quintero
The Product Philosophy Behind EnjoyHQ
2021 • Advancing Research 2021
Gold
April Reagan
Look, Think, Act: The Futures-Smart Design Organization
2021 • DesignOps Summit 2021
Gold
Boon Yew Chew
Making Sense of Systems—and Using Systems to Make Sense of the Enterprise
2023 • Enterprise UX 2023
Gold
Ana Maria Montero Barrantes
The Authentic UX Talent Show
2024 • Enterprise Experience 2020
Gold
Amahra Spence
Designing for Liberation, Rehearsing Freedom
2022 • Civic Design 2022
Gold
Joseph Meersman
Sweating the Pixel: Scaling Quality through Critique
2021 • Design at Scale 2021
Gold
Alla Weinberg
Healing Toxic Stress
2024 • DesignOps Summit 2024
Gold
Jason Mesut
Shaping design, designers and teams
2018 • DesignOps Summit 2018
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold
Eduardo Ortiz
Day 3 Theme Panel
2025 • Advancing Research 2025
Gold
Mila Kuznetsova
How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices
2022 • Advancing Research 2022
Gold
Abby Covert
Stuck? Diagrams Help
2022 • DesignOps Community

More Videos

Christopher Noessel

"We risk deskilling users and overreliance, where people rubber stamp AI output without critical thought."

Christopher Noessel

AI of the now: Designing for Agents

July 31, 2024

Caroline Vize

"For many organizations, research is really not embedded completely and consistently into the development process."

Caroline Vize

The State of UX: Five Lessons from 2021 to Accelerate Digital Experience in 2022

March 9, 2022

Kate Koch

"Super strength is the resilience and endurance to partner and drive strategic impact backed by customer obsession."

Kate Koch Prateek Kalli

Flex Your Super Powers: When a Design Ops Team Scales to Power CX

September 30, 2021

Jessamyn Edwards

"Give a why of why you’ve made this design decision. It helps your team understand and reduces defensiveness."

Jessamyn Edwards

Surviving Your UX Career in Enterprise Design

December 2, 2021

Jemma Ahmed

"If you miss any one of these—access to data, insight generation, accuracy, engagement—it’s not truly democratization."

Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher Nash

Democratization: Working with it, not against it [Advancing Research Community Workshop Series]

July 24, 2024

Sharbani Dhar

"It’s never over; it’s a continuous process of improvement."

Sharbani Dhar

Breathing Room for Delight

January 8, 2024

Ned Dwyer

"There was a feeling at Brex that research was sometimes conducted for the sake of research, not resulting in impactful insights."

Ned Dwyer Emily Stewart James Wallis

The Intersection of Design and ResearchOps

September 24, 2024

Bud Caddell

"Susan Sogato will talk about culture as a key driver of customer success and its operational impact."

Bud Caddell

Theme 2 Intro

September 30, 2021

Michael Weir

"If a website is hard to use, motivation and approach drops, and users are less likely to engage or convert."

Michael Weir

Mixed Methods and Behavioural Science

May 26, 2023

Latest Books All books