Summary
Research is an inherent part of design, and operationalizing how insights are generated and used is one of the more challenging aspects of design operations. Overcoming the lack of good tools, taming the complexity of research at scale, and navigating the world of different forms of inquiry are just a few of the obstacles to overcome. That said, we are starting to see a range of benefits from implementing research operations in modern design organizations.
Key Insights
-
•
Banks like Capital One must manage research amid strict regulations and risk, requiring innovative recruiting and study designs.
-
•
Specialized research operations and curricula teams at Capital One remove procedural inefficiencies and ensure compliance.
-
•
Risk Management at Capital One includes embedded 'risk-sharper' roles that guide research teams through compliance challenges.
-
•
'Wine and dine' sessions enable rich qualitative insights by combining customer interaction with large employee participation, without traditional focus group pitfalls.
-
•
User research approaches must vary by business context: B2C, B2B, and internal IT differ greatly in user access and needs.
-
•
Agile’s dominance in software development creates challenges for user-centered design integration, requiring adaptations or use of Lean methodologies.
-
•
Qualitative research provides rich user insight and inspiration for designers, while executives rely more on quantitative data for decision-making.
-
•
The PURE method formalizes usability evaluation through expert ratings, producing measurable scores that drive executive action and product improvement.
-
•
The user experience talent pool is small and highly sought after, making it critical to structure roles to attract and retain specialists rather than expecting 'unicorns.'
-
•
Effective knowledge management for UX research must support the entire insight lifecycle—from ideation to product impact—to avoid losing valuable learnings.
Notable Quotes
"Capital One is really a bank ... it’s out to change banking for good by becoming a tech company that just happens to do banking."
"We call it research goo: regulation, risk, inefficiencies that complicate research in banks."
"Risk-sharper is a role assigned within Risk Management that carries teams through the risk process to mitigate it."
"Wine and dine is not a focus group; it’s more employees than customers interacting in small groups to get deep insights."
"In business-to-business contexts, finding a champion within your sales or account management teams can open access to users for research."
"You need to know tomorrow’s user as well as today’s because their characteristics differ greatly according to diffusion of innovation."
"Agile is here to stay because engineering managers won’t hire for anything else; user-centered design must fit into Agile somehow."
"Designers thrive on qualitative research because it gives them access to the root of the problem beyond just numbers."
"Never put numbers on qualitative research findings; qualitative insights are about richness and why, not how many."
"The PURE method measures usability by scoring cognitive load and friction at each step of fundamental user tasks."
Or choose a question:
More Videos
"If we haven’t defined and branded ourselves, others will—and others could be wrong."
Molly FargotsteinMultipurpose Communication & UX Research Marketing
September 12, 2019
"Behavioral fit means the system’s behavior matches the behavior and mental models of users."
Dave MaloufClosing Keynote: Amplify. Not Optimize.
October 24, 2019
"These tools are the most powerful symbol manipulation tools ever created, like spreadsheets for language."
Jorge ArangoAI as Thought Partner: How to Use LLMs to Transform Your Notes (3rd of 3 seminars)
May 3, 2024
"The future was already here. It’s just not evenly distributed."
Daniel J. RosenbergDesigning with and for Artificial Intelligence
August 11, 2022
"No design system will ever be fully accessible because new features and permutations are always being introduced."
Alexis LucioScaling Accessibility Through Design Systems
June 9, 2022
"We created a Slack bot that automatically created tickets from UX bug reports to help design managers discover issues faster and track recovery time."
Peter BoersmaHow to Define and Maintain a DesignOps Roadmap
October 3, 2023
"Service design is not only supporting but leading – it’s about having opinion and data to lead change."
Ben Reason Aline Horta Majid Iqbal Fabiano LeoniMaking the system visible: The fastest path to better decisions
November 20, 2025
"The content behind this bot is curated and high quality, unlike the typical confusing, outdated information in corporate repositories."
Peter Van Dijck Louis RosenfeldCoffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
June 14, 2024
"Technology is a series of choices designers and technologists make, often small but impactful; we must demand better choices that work for all of us."
Taylor KlassmanShaping the Next Era of UX Research: Collaborative Forum
March 11, 2025
Latest Books All books
Dig deeper with the Rosenbot
Why do private sector innovation models often fail when applied directly to public sector organizations?
What are best practices for conducting workshops that create team alignment beyond task outputs?
How do competing AI agents within an enterprise environment require new design approaches for prioritization and control?