Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Measuring Up: Using Product Research for Organizational Impact
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
Measuring Up: Using Product Research for Organizational Impact
Speakers: Mac Smith
Link:

Summary

Research for product work is well established; but how do you lead your research team to shape organizational goals? We’ll use a case study from Google to demonstrate how many of the same techniques, methods, and skills you and your team have today can be used to guide an organization’s goals. We’ll also discuss key changes to make for organizational success - from integrating with other insight functions to shifting how your team defines themselves and their work. The results are research organizations that produce insights to impact how your organization defines their goals.

Key Insights

  • Early UX research focused on evaluating decisions after they were made, but now researchers can influence product strategy and organizational alignment.

  • Assessing how the organization and research teams perceive themselves is crucial to identify gaps and opportunities for influence.

  • Researchers often excel in craft and domain expertise but may lack critical business acumen and advising skills, which limits their impact.

  • Setting an audacious, long-term goal energizes teams and elevates their mindset towards influencing leadership-level decisions.

  • All customer contact can be strategic if research questions are intentionally mapped to organizational goals; the tactical vs strategic distinction is often false.

  • Finding a high-level champion before defining problems is essential to accessing key information and aligning research efforts with business priorities.

  • Collaboration across user research, data science, and market research enables producing trusted, generalizable data for executives.

  • Mapping research findings to business metrics, like queries in search, makes the impact clear and drives organizational buy-in.

  • Delivering strategic insights becomes easier after careful preparation and alignment phases focused on relationships and timing.

  • Individual researchers can advance influence by leveraging established relationships and growing business and advising skills alongside their research craft.

Notable Quotes

"Leadership growth among UX research is still fairly organic, so we need to learn how to establish ourselves to take leadership roles."

"If you can follow the simple steps of preparing, aligning, and delivering, you can shift the focus and impact of your team."

"We had a great depth of customer understanding, but our view of partners was two-dimensional; we didn't know their needs or goals well."

"Success was often about personal relationships; having the right data wasn’t enough without the right connections."

"Many leaders didn’t know how to engage with research beyond usability and experimentation."

"We set a two-year goal to advise leadership on top issues for annual planning, even though we hadn’t figured out all the steps."

"Any customer contact is touching on strategic foundations — the tactical versus strategic mindset is a false dichotomy."

"Find your champion before you identify the problems to solve; this person helps navigate complex organizational alignment."

"User research excels at explaining why things happen; data science explains what and how; together they build trusted insight."

"By connecting complex user journeys to queries, we made the impact on business bottom lines explicit and compelling."

Ask the Rosenbot
Patrizia Bertini
The (r)evolution of designOps: It’s Time to Think (really) BIG
2025 • DesignOps Summit 2025
Gold
Mujtaba Hameed
The new horizon of ethnography: using AI to unlock the full potential of in-person research
2026 • Advancing Research 2026
Conference
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Kristin Skinner
Opening Keynote: Org Design for Design Orgs
2017 • DesignOps Summit 2017
Gold
Sheryl Cababa
Living in the Clouds: Adopting a Systems Thinking Mindset
2023 • Enterprise UX 2023
Gold
Iram Shah
Closing Keynote: The View from the Top
2019 • Enterprise Experience 2019
Gold
Malini Rao
Lessons Learned from a 4-year Product Re-platforming Journey
2021 • Design at Scale 2021
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Carl Turner
You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
2023 • Advancing Research 2023
Gold
Onur Kocan
Understanding the Strategy for Civic Design in a Complex City: Istanbul
2022 • Civic Design 2022
Gold
Maria Rosala
Research Repositories
2026 • Advancing Research 2026
Conference
Uday Gajendar
Day 1 Welcome
2024 • Designing with AI 2024
Gold
Briana Thomas
The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
2024 • DesignOps Summit 2024
Gold
Ari Zelmanow
Dark Side of Democratization
2023 • Advancing Research Community
Jennifer Kanyamibwa
Creating the Blueprint: Growing and Building Design Teams
2018 • DesignOps Summit 2018
Gold
Karen McGrane
AI for Information Architects: Are the robots coming for our jobs?
2024 • Rosenfeld Community

More Videos

Louis Rosenfeld

"One of the easiest ways to gain trust is really to talk and think and act like a designer or a researcher if I’m joining a research team."

Louis Rosenfeld Jose Coronado Rachel Posman Guneet Singh Crystal Yan

The Bigger Picture: A Panel Discussion

October 23, 2019

Scher Foord

"Trust is hard to find but essential; we hire smart people so let’s all trust and move forward."

Scher Foord Corey Greenltch Sarah Rowe

Turn the Ship Around: How to Apply Design Thinking Across Your Organization

June 10, 2021

Sam Proulx

"Alternative navigation users pick different tools based on the task and how they feel at that moment, not just one technology."

Sam Proulx

SUS: A System Unusable for Twenty Percent of the Population

December 9, 2021

Josh Clark

"The Pinocchio pattern is about turning an idea, a concept, into a working reality with machine intelligence as a collaborator."

Josh Clark Veronika Kindred

Sentient Design, AI, and the Radically Adaptive Experience (1st of 3 seminars)

January 15, 2025

Christopher Noessel

"We risk deskilling users and overreliance, where people rubber stamp AI output without critical thought."

Christopher Noessel

AI of the now: Designing for Agents

July 31, 2024

Steve Portigal

"Research is complex because we use the term to mean anything and everything."

Steve Portigal

Looking Back…to Look Ahead

March 26, 2024

Kristin Taylor

"If we avoid how we work together, we create disjointed experiences and cause confusion and frustration for riders."

Kristin Taylor

Building Bridges Across Organizational Silos

November 18, 2022

Erin Weigel

"Everything is an experiment."

Erin Weigel

Real-world lessons to improve your conversion rates

June 26, 2024

Maverick Chan

"Feeding interview data into ChatGPT helped us develop realistic character profiles and dialogues."

Maverick Chan Claire Lin

From Doodle to Demo: AI as Our Storytelling Partner

October 23, 2025