Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Research Operations at Scale
Gold
Tuesday, November 7, 2017 • DesignOps Summit 2017
Share the love for this talk
Research Operations at Scale
Speakers: Christian Rohrer
Link:

Summary

Research is an inherent part of design, and operationalizing how insights are generated and used is one of the more challenging aspects of design operations. Overcoming the lack of good tools, taming the complexity of research at scale, and navigating the world of different forms of inquiry are just a few of the obstacles to overcome. That said, we are starting to see a range of benefits from implementing research operations in modern design organizations.

Key Insights

  • Banks like Capital One must manage research amid strict regulations and risk, requiring innovative recruiting and study designs.

  • Specialized research operations and curricula teams at Capital One remove procedural inefficiencies and ensure compliance.

  • Risk Management at Capital One includes embedded 'risk-sharper' roles that guide research teams through compliance challenges.

  • 'Wine and dine' sessions enable rich qualitative insights by combining customer interaction with large employee participation, without traditional focus group pitfalls.

  • User research approaches must vary by business context: B2C, B2B, and internal IT differ greatly in user access and needs.

  • Agile’s dominance in software development creates challenges for user-centered design integration, requiring adaptations or use of Lean methodologies.

  • Qualitative research provides rich user insight and inspiration for designers, while executives rely more on quantitative data for decision-making.

  • The PURE method formalizes usability evaluation through expert ratings, producing measurable scores that drive executive action and product improvement.

  • The user experience talent pool is small and highly sought after, making it critical to structure roles to attract and retain specialists rather than expecting 'unicorns.'

  • Effective knowledge management for UX research must support the entire insight lifecycle—from ideation to product impact—to avoid losing valuable learnings.

Notable Quotes

"Capital One is really a bank ... it’s out to change banking for good by becoming a tech company that just happens to do banking."

"We call it research goo: regulation, risk, inefficiencies that complicate research in banks."

"Risk-sharper is a role assigned within Risk Management that carries teams through the risk process to mitigate it."

"Wine and dine is not a focus group; it’s more employees than customers interacting in small groups to get deep insights."

"In business-to-business contexts, finding a champion within your sales or account management teams can open access to users for research."

"You need to know tomorrow’s user as well as today’s because their characteristics differ greatly according to diffusion of innovation."

"Agile is here to stay because engineering managers won’t hire for anything else; user-centered design must fit into Agile somehow."

"Designers thrive on qualitative research because it gives them access to the root of the problem beyond just numbers."

"Never put numbers on qualitative research findings; qualitative insights are about richness and why, not how many."

"The PURE method measures usability by scoring cognitive load and friction at each step of fundamental user tasks."

Ask the Rosenbot
Andrew Webster
Scaling Design Capability: How Involved Should You Be?
2021 • DesignOps Summit 2021
Gold
Kristin Skinner
Five Years of DesignOps
2021 • DesignOps Summit 2021
Gold
Rob Mitzel
The Tale of Two Companies: Building a Successful UX Practice in a Century-Old Enterprise
2024 • Enterprise Experience 2020
Gold
Russ Unger
Onboarding: The Ecosystem, not the Afterthought
2017 • DesignOps Summit 2017
Gold
Sheryl Cababa
Thinking in systems to address climate with Sheryl Cababa
2024 • Climate UX Interest Group
Kristin Wisnewski
Measuring What Matters
2019 • DesignOps Summit 2019
Gold
Janaki Kumar
Innovate with Purpose
2018 • Enterprise Experience 2018
Gold
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Alana Washington
Theme 1: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Mike Oren
Why Pharmaceutical's Research Model Should Replace Design Thinking
2023 • Advancing Research 2023
Gold
James Rampton
The Basics of Automotive UX & Why Phones Are a Part of That Future
2024 • Rosenfeld Community
Shazia Ali
Communication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Amy Bucher
Harnessing behavioral science to uncover deeper truths
2025 • Advancing Research 2025
Gold
Frank Duran
Partnership Playbook: Lessons Learned in Effective Partnership
2024 • Enterprise Experience 2020
Gold
Suzan Bednarz
AccessibilityOps for All
2024 • DesignOps Summit 2020
Gold

More Videos

Malini Rao

"Designing for change means focusing on learnability and product consumability, not just ease of use."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021

Katie Hansen

"Selection bias, overgeneralization, data variability, and time constraints are common challenges to synthesis."

Katie Hansen

Finding the unknown in the known: Harnessing meta-analysis and literature review

March 12, 2025

Peter Merholz

"We freak out when leadership acts irrationally, but we accept that users do the same because we understand them better."

Peter Merholz

The Trials and Tribulations of Directors of UX

July 13, 2023

Maria Rosala

"You cannot just put this 5% of users did not want this without knowing why or where this insight came from."

Maria Rosala Shivanjali M.

Research Repositories

March 12, 2026

Dane DeSutter

"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."

Dane DeSutter

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not

March 26, 2024

Ebru Namaldi

"Design ops is a way to care for the people who design."

Ebru Namaldi

Designing the Designer’s Journey: Scaling Teams, Culture, and Growth Through DesignOps

September 11, 2025

Aaron Stienstra

"Customer experience cannot truly be good if some are left out or excluded, either intentionally or unintentionally."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021

Dave Malouf

"Our mantra is tools, not rules. Make it easier for people to do their jobs and they’ll use the design system."

Dave Malouf Amy Thibodeau

Panel: Design Systems and Documentation

November 7, 2017

Scott Plewes

"The SIR model is simple but can be applied beyond viruses—to information spread, finance, and UX adoption."

Scott Plewes

Why Isn't Your UX Approach Going Viral?: A Mathematical Model

March 28, 2023