Summary
As more organizations embrace research we move on to the second generation question – how do we scale this user centered behavior to support demand? There are fairly systemic issues that can undermine our best intentions. At best, it can render our research wasteful and inefficient, and at worst it can introduce significant risks in the decision making that our teams make. This talk considers five of the most likely challenges you’ll rub up against – speed, silos, teams, numbers and failure to mature. We’ll then discuss what causes these and what you can do to mitigate risks for your organization.
Key Insights
-
•
Democratizing research can significantly enhance product development by involving diverse team members.
-
•
Empathy for different user contexts is crucial to avoid self-referential design in research.
-
•
There is a tension between speed and the quality of research; quick fixes can lead to biased outcomes.
-
•
Two key aspects of customer closeness are empathy and evidence gathering, each requiring different approaches.
-
•
Siloed teams tend to focus too narrowly on their features, missing broader contextual insights that matter.
-
•
Quantitative data can overshadow qualitative insights, leading to poor decision-making in research.
-
•
Research processes, if not planned for, can compromise data quality; teams should allow sufficient time for analysis.
-
•
Effective communication among team members about research quality is essential for better decision-making.
-
•
Understanding the balance between user needs and team ownership can reduce conflict over design decisions.
-
•
Investing appropriate resources in research relative to the risk involved leads to better-informed product decisions.
Notable Quotes
"I want to acknowledge their gated-goal people and the people of your nation which is where I stand today."
"Generally speaking, having our teams involving people as a part of their design process is a good thing."
"Getting closer to customers is also about gathering evidence, looking at the facts."
"The need for speed can introduce problematic trade-offs that lead to biased research."
"We should always be designing and researching by considering a feature in its next largest context."
"Siloed teams often only care about what they can control, seeking validation in their research."
"The main thing that the team was talking about when they talked about design was data, the research evidence."
"Numbers hog the limelight but they shouldn't overshadow important qualitative insights."
"Researching end-to-end journeys allows for a more efficient working method and reliable outcomes."
"Our job is to reduce the risk of investing in the wrong place or in the wrong way."
















More Videos

"You are not just trusting an LLM; they are not databases, they mess up in ways databases never would."
Noz UrbinaRapid AI-powered UX (RAUX): A framework for empowering human designers
May 1, 2025

"We have lots of chances to learn from each other as we iterate."
Jim KalbachJazz Improvisation as a Model for Team Collaboration
June 4, 2019

"When you onboard somebody new, give them a journal."
Holly ColeUnderstanding Experiences: When you have to do more than work
November 8, 2018

"We're not doing just a simple flip of our boards, this is actually contained code."
Jack BeharHow to Build Prototypes that Behave like an End-Product
December 6, 2022

"Our sponsors put a lot of effort into the sessions so that they can be as high quality as possible for you."
Bria AlexanderOpening Remarks
October 3, 2023

"Lean into hope; it's the only thing that drives conversations forward in AI."
Erika FlowersAI-Readiness: Preparing NASA for a Data-Driven, Agile Future
June 10, 2025

"Learning should be an experience tailored around the learner, not the curriculum."
Kristin SkinnerFive Years of DesignOps
September 29, 2021

"Without these rules and these conventions, we wouldn't have the creativity on top of it."
Jim KalbachJazz Improvisation as a Model for Team Collaboration
November 6, 2017

"We need to tap into everybody's creativity to find solutions for societal challenges."
Surya VankaUnleashing Swarm Creativity to Solve Enterprise Challenges
June 10, 2021