Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

The Five Dysfunctions of Democratized Research at Scale
Gold
Monday, March 30, 2020 • Advancing Research 2020
Share the love for this talk
The Five Dysfunctions of Democratized Research at Scale
Speakers: Leisa Reichelt
Link:

Summary

As more organizations embrace research we move on to the second generation question – how do we scale this user centered behavior to support demand? There are fairly systemic issues that can undermine our best intentions. At best, it can render our research wasteful and inefficient, and at worst it can introduce significant risks in the decision making that our teams make. This talk considers five of the most likely challenges you’ll rub up against – speed, silos, teams, numbers and failure to mature. We’ll then discuss what causes these and what you can do to mitigate risks for your organization.

Key Insights

  • Democratizing research can significantly enhance product development by involving diverse team members.

  • Empathy for different user contexts is crucial to avoid self-referential design in research.

  • There is a tension between speed and the quality of research; quick fixes can lead to biased outcomes.

  • Two key aspects of customer closeness are empathy and evidence gathering, each requiring different approaches.

  • Siloed teams tend to focus too narrowly on their features, missing broader contextual insights that matter.

  • Quantitative data can overshadow qualitative insights, leading to poor decision-making in research.

  • Research processes, if not planned for, can compromise data quality; teams should allow sufficient time for analysis.

  • Effective communication among team members about research quality is essential for better decision-making.

  • Understanding the balance between user needs and team ownership can reduce conflict over design decisions.

  • Investing appropriate resources in research relative to the risk involved leads to better-informed product decisions.

Notable Quotes

"I want to acknowledge their gated-goal people and the people of your nation which is where I stand today."

"Generally speaking, having our teams involving people as a part of their design process is a good thing."

"Getting closer to customers is also about gathering evidence, looking at the facts."

"The need for speed can introduce problematic trade-offs that lead to biased research."

"We should always be designing and researching by considering a feature in its next largest context."

"Siloed teams often only care about what they can control, seeking validation in their research."

"The main thing that the team was talking about when they talked about design was data, the research evidence."

"Numbers hog the limelight but they shouldn't overshadow important qualitative insights."

"Researching end-to-end journeys allows for a more efficient working method and reliable outcomes."

"Our job is to reduce the risk of investing in the wrong place or in the wrong way."

More Videos

Ed Mullen

"In government service delivery, design without implementation is just theory and won't yield results."

Ed Mullen

Designing the Unseen: Enabling Institutions to Build Public Trust

November 16, 2022

Peter Levin

"Cell phones were going to directly compete with personal computers and Intel should both accommodate this new communications medium and also adjust its strategy."

Peter Levin

Solve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility

March 25, 2024

Bria Alexander

"Have conversations and ask the right questions about the objectives."

Bria Alexander Benson Low Natalya Pemberton Stephanie Goldthorpe

OKRs—Helpful or Harmful?

January 20, 2022

Kate Koch

"We actually discovered our superpowers"

Kate Koch Prateek Kalli

Flex Your Super Powers: When a Design Ops Team Scales to Power CX

September 30, 2021

Amy Marquez

"Show them, don’t tell them."

Amy Marquez

INVEST: Discussion

June 15, 2018

Brenna Fallon

"Be okay with it being messy; humans are less predictable than algorithms."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Brian Moss

"It's vital to communicate that researchers are not a burden when they express their needs."

Brian Moss

What Does it Mean to be a Resilient Research Team?

March 9, 2022

Adel Du Toit

"We hold the mirror up to our product teams and also to every single one of our 25,000 employees."

Adel Du Toit

Get Your CFO To Say: 'Our Strategic Goal is User Obsession'

June 10, 2022

Kate Koch

"We're super ops, and we've discovered we have a lot of superpowers."

Kate Koch Jean-Claire Fitschen

Flex Your Super Powers: When a Design Ops Team Scales to Power CX

September 29, 2021