Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Measuring Up: Using Product Research for Organizational Impact
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
Measuring Up: Using Product Research for Organizational Impact
Speakers: Mac Smith
Link:

Summary

Research for product work is well established; but how do you lead your research team to shape organizational goals? We’ll use a case study from Google to demonstrate how many of the same techniques, methods, and skills you and your team have today can be used to guide an organization’s goals. We’ll also discuss key changes to make for organizational success - from integrating with other insight functions to shifting how your team defines themselves and their work. The results are research organizations that produce insights to impact how your organization defines their goals.

Key Insights

  • Early UX research focused on evaluating decisions after they were made, but now researchers can influence product strategy and organizational alignment.

  • Assessing how the organization and research teams perceive themselves is crucial to identify gaps and opportunities for influence.

  • Researchers often excel in craft and domain expertise but may lack critical business acumen and advising skills, which limits their impact.

  • Setting an audacious, long-term goal energizes teams and elevates their mindset towards influencing leadership-level decisions.

  • All customer contact can be strategic if research questions are intentionally mapped to organizational goals; the tactical vs strategic distinction is often false.

  • Finding a high-level champion before defining problems is essential to accessing key information and aligning research efforts with business priorities.

  • Collaboration across user research, data science, and market research enables producing trusted, generalizable data for executives.

  • Mapping research findings to business metrics, like queries in search, makes the impact clear and drives organizational buy-in.

  • Delivering strategic insights becomes easier after careful preparation and alignment phases focused on relationships and timing.

  • Individual researchers can advance influence by leveraging established relationships and growing business and advising skills alongside their research craft.

Notable Quotes

"Leadership growth among UX research is still fairly organic, so we need to learn how to establish ourselves to take leadership roles."

"If you can follow the simple steps of preparing, aligning, and delivering, you can shift the focus and impact of your team."

"We had a great depth of customer understanding, but our view of partners was two-dimensional; we didn't know their needs or goals well."

"Success was often about personal relationships; having the right data wasn’t enough without the right connections."

"Many leaders didn’t know how to engage with research beyond usability and experimentation."

"We set a two-year goal to advise leadership on top issues for annual planning, even though we hadn’t figured out all the steps."

"Any customer contact is touching on strategic foundations — the tactical versus strategic mindset is a false dichotomy."

"Find your champion before you identify the problems to solve; this person helps navigate complex organizational alignment."

"User research excels at explaining why things happen; data science explains what and how; together they build trusted insight."

"By connecting complex user journeys to queries, we made the impact on business bottom lines explicit and compelling."

Ask the Rosenbot
Jemma Ahmed
Theme Three Intro
2023 • Advancing Research 2023
Gold
Trisha Terhar
Empathizing with the Empowered: Non-Researcher Responses to Democratization
2022 • Advancing Research 2022
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • DesignOps Summit 2023
Gold
Sheryl Cababa
Living in the Clouds: Adopting a Systems Thinking Mindset
2023 • Enterprise UX 2023
Gold
Cheryl Platz
Merging Improv with Design
2019 • Enterprise Community
Rachael Dietkus, LCSW
Trauma-Responsive Design: Reimagining the Future of Design Now
2021 • Civic Design 2021
Gold
Jen Crim
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold
Mac Smith
Measuring Up: Using Product Research for Organizational Impact
2021 • Advancing Research 2021
Gold
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Alla Weinberg
People Are Sick of Change: Psychological Safety is the Cure
2023 • DesignOps Community
Shanti Mathew
Civic Design at Scale: Introducing the Public Policy Layer Cake
2021 • Civic Design 2021
Gold
Ariba Jahan
Team Resiliency Through a Pandemic
2024 • DesignOps Summit 2020
Gold
Rebecca Topps
Planning and conducting remote usability studies for accessibility
2020 • Advancing Research Community
Jake Burghardt
Stop wasting research: Create new value with insight summaries
2025 • Rosenfeld Community
Elizabeth Sklar
Co-creating research enablement with your tech org: a case study
2026 • Advancing Research 2026
Conference

More Videos

Christian Crumlish

"If you don’t have a little earthquake every now and then, you have a real big one after a while."

Christian Crumlish Wendy Johansson Rich Mironov Aditi Ruiz Adam Thomas

Afternoon Insights Panel

December 6, 2022

Michael Land

"Hiring specs for federal designers don’t exist as we expect—jobs are often classified as public affairs or other unrelated titles."

Michael Land

Establishing Design Operations in Government

February 18, 2021

Bria Alexander

"The conference is your annual opportunity to get to know each other and to step back together and amplify the power of design."

Bria Alexander Louis Rosenfeld

Welcome

September 8, 2022

Surya Vanka

"The purpose of design is not to celebrate a solo genius, but to help create a just and equitable world for everyone."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021

Cassandra Piester

"Everyone has thoughts on what their job is, so starting with roles and responsibilities gets quick buy-in."

Cassandra Piester

Developing and Deploying Your Design Operations Strategy

September 24, 2024

Ariel Kennan

"Whether you are a student, designer, or government worker, there is advice for getting started in Civic Design."

Ariel Kennan

Theme 2 Intro

December 9, 2021

Joshua Graves

"Embracing seasonality in influence means adapting your expectations to current conditions."

Joshua Graves

We Need To Talk: Navigating Conversations with Your Boss (Part 1 of 3)

April 14, 2025

Peter Van Dijck

"An agent is a model using tools in a loop, making plans, reasoning, and calling tools until it’s done."

Peter Van Dijck

Building impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!

July 30, 2025

Bria Alexander

"Our sponsor sessions are not sales pitches; they are serious, high content learning opportunities for everyone."

Bria Alexander

Opening Remarks

November 17, 2022