Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Research Operations at Scale
Gold
Tuesday, November 7, 2017 • DesignOps Summit 2017
Share the love for this talk
Research Operations at Scale
Speakers: Christian Rohrer
Link:

Summary

Research is an inherent part of design, and operationalizing how insights are generated and used is one of the more challenging aspects of design operations. Overcoming the lack of good tools, taming the complexity of research at scale, and navigating the world of different forms of inquiry are just a few of the obstacles to overcome. That said, we are starting to see a range of benefits from implementing research operations in modern design organizations.

Key Insights

  • Banks like Capital One must manage research amid strict regulations and risk, requiring innovative recruiting and study designs.

  • Specialized research operations and curricula teams at Capital One remove procedural inefficiencies and ensure compliance.

  • Risk Management at Capital One includes embedded 'risk-sharper' roles that guide research teams through compliance challenges.

  • 'Wine and dine' sessions enable rich qualitative insights by combining customer interaction with large employee participation, without traditional focus group pitfalls.

  • User research approaches must vary by business context: B2C, B2B, and internal IT differ greatly in user access and needs.

  • Agile’s dominance in software development creates challenges for user-centered design integration, requiring adaptations or use of Lean methodologies.

  • Qualitative research provides rich user insight and inspiration for designers, while executives rely more on quantitative data for decision-making.

  • The PURE method formalizes usability evaluation through expert ratings, producing measurable scores that drive executive action and product improvement.

  • The user experience talent pool is small and highly sought after, making it critical to structure roles to attract and retain specialists rather than expecting 'unicorns.'

  • Effective knowledge management for UX research must support the entire insight lifecycle—from ideation to product impact—to avoid losing valuable learnings.

Notable Quotes

"Capital One is really a bank ... it’s out to change banking for good by becoming a tech company that just happens to do banking."

"We call it research goo: regulation, risk, inefficiencies that complicate research in banks."

"Risk-sharper is a role assigned within Risk Management that carries teams through the risk process to mitigate it."

"Wine and dine is not a focus group; it’s more employees than customers interacting in small groups to get deep insights."

"In business-to-business contexts, finding a champion within your sales or account management teams can open access to users for research."

"You need to know tomorrow’s user as well as today’s because their characteristics differ greatly according to diffusion of innovation."

"Agile is here to stay because engineering managers won’t hire for anything else; user-centered design must fit into Agile somehow."

"Designers thrive on qualitative research because it gives them access to the root of the problem beyond just numbers."

"Never put numbers on qualitative research findings; qualitative insights are about richness and why, not how many."

"The PURE method measures usability by scoring cognitive load and friction at each step of fundamental user tasks."

Ask the Rosenbot
Nathan Shedroff
How Will Design be Taught When the Schools Shut Down?
2026 • Rosenfeld Community
Nalini P. Kotamraju
An Organizational Story: Salesforce Lightning Design System
2016 • Enterprise UX 2016
Gold
Sandra Camacho
Creating More Bias-Proof Designs
2025 • Rosenfeld Community
Ryan Rumsey
Business Influence Without Losing Your Soul
2021 • Enterprise Community
Brennan Hartich
Communicating and Establishing DesignOps as a New Function
2018 • DesignOps Summit 2018
Gold
Louis Rosenfeld
Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?
2024 • Rosenfeld Community
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2017 • DesignOps Summit 2017
Gold
Bria Alexander
Opening Remarks
2023 • Advancing Research 2023
Gold
Jennifer Bolduc
What's involved with getting people back to work?: A panel discussion
2021 • DesignOps Community
Dave Hora
Advice for Establishing Research
2022 • Advancing Research Community
Jennifer Fraser
What would Emmy Noether Do? Math, Models and Mulling in UX Research
2023 • Advancing Research 2023
Gold
Patrick Boehler
Fishing for Real Needs: Reimagining Journalism Needs with AI
2025 • Designing with AI 2025
Gold
Sam Ladner
Data Exhaust and Personal Data: Learning from Consumer Products to Enhance Enterprise UX
2016 • Enterprise UX 2016
Gold
Louis Rosenfeld
Coffee with Lou: Should You Write a (UX) Book?
2024 • Rosenfeld Community
Cennydd Bowles
Day 1 Panel
2024 • Designing with AI 2024
Gold
Daniel Korczynski
Why AI Is Bad at Research (and how to make it actually useful)
2026 • Advancing Research 2026
Conference

More Videos

Rachel Posman

"Design ops isn’t just a support role; it is a strategic partner involved in decision making."

Rachel Posman John Calhoun

"Ask Me Anything" with Rachel Posman and John Calhoun, Authors of the Upcoming Rosenfeld Book, The Design Conductors

September 25, 2024

Ash Brown

"We're at a pivotal moment where technology can truly make a difference in sustainability."

Ash Brown

Silver Linings: What DesignOps Learned in the Shift to WFH

October 23, 2020

Gabriela Barneva

"Testing accessibility at the design system level before design starts catches many issues early on."

Gabriela Barneva

Operationalizing Inclusive Design in Service Design

November 20, 2025

Kwabena Opoku

"I use storytelling as armor to present findings clients may not want to hear, preserving the authentic voice."

Kwabena Opoku Leonie Annor-Owiredu Sam Ladner

Methodological toolkit for unique research impact

March 11, 2026

Sam Proulx

"The experience of using a screen reader is probably 10 times faster as you become more expert with it."

Sam Proulx

Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users

December 10, 2021

James Lang

"Extractive, commercially-driven communities aren’t really communities in the pure sense."

James Lang

If you can design an app, you can design a community

May 22, 2025

Tiffany Cheng

"The most important thing to remember is to be flexible in your concept of a deliverable."

Tiffany Cheng

Designing in a Pandemic: Integrating Speed and Rigor

June 9, 2022

Peter Merholz

"Super senior individual contributors can focus on strategic and creative work that design directors and VPs often don’t have time for."

Peter Merholz

Design at Scale is People!

June 11, 2021

Victor Udoewa

"Cultural and experiential knowledge are greater than institutional knowledge."

Victor Udoewa

Radical Participatory Research: Decolonizing Participatory Processes

March 9, 2022