Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right

Gold
Tuesday, March 28, 2023 • Advancing Research 2023
Share the love for this talk
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Speakers: Anne Mamaghani
Link:

Summary

Generative workshops are a critical generative component of any product development process. But in my 20+ years conducting product user research, I have seen more product harm come from so-called "workshops" or "design sprints" than good. In this tutorial, I will share more about my experience and what I've found are critical components of generative workshops -- whether they last five hours or five days. Contrary to popular belief, a design sprint is a highly structured and carefully designed series of exercises, not a brainstorm, design jam or free-for-all. The whole point is to drive a cross-functional team to the right outcome, and this requires a set of structured exercises which weave the thread of user needs, behaviors and attitudes throughout. This involves more than reviewing the research at the start and then moving on to create without that research in context. A true design sprint takes us from user insights -- even broad user insights -- to user-evaluated concepts or designs. The generative phase of a product is deeply impactful, and design sprints are a fantastic tool for driving this needed impact. However, many are practicing brainstorms or design jams rather than true design sprints. One can make a mismatched concept extremely usable throughout the product development process, but that will not remedy the fact that it is not the right concept. Researchers are ideal design sprint organizers and facilitators, but researchers are sometimes not even considered a critical component of the sprint. It's important for knowledgeable researchers to drive design sprint impact.

Key Insights

  • Many generative workshops fail due to fundamental mistakes more often than they succeed.

  • The 'Sprint as theater' mistake occurs when workshops are done for appearances or political reasons rather than genuine product development.

  • Well-structured workshops with specific exercises are crucial to move from research data to human-centered product concepts.

  • Integrating research both before and after a workshop grounds concepts in real human needs and allows recovery if initial research is missing.

  • Excluding key decision-makers leads to surprise blockers after workshops and risks misalignment with product goals.

  • Facilitation is a distinct, practiced skill essential to managing group dynamics, pacing, and adapting exercises during workshops.

  • Scaling back workshops too much compromises their effectiveness and the quality of resulting concepts.

  • Explicit communication about workshop outcomes and quality is necessary to help stakeholders appreciate the method's value.

  • Training facilitators in focused, incremental sessions delivers practical skills necessary for leading effective workshops.

  • Ensuring equal participation requires setting clear engagement rules and providing tool training to accommodate varying skill levels.

Notable Quotes

"The outcome of this method really makes the difference between lightning and a lightning bug."

"Sprint as theater is not going to result in a product concept that really represents human needs, behaviors, and attitudes."

"If there is no structured way to move from data to concept, you often end up with just a brainstorm, not a grounded concept."

"Lack of research before or after the workshop can be recovered from but at some cost to the concept’s validity."

"Excluding key people might save time but it often leads to surprise blockers and misaligned decisions later on."

"Facilitation is a skill that takes real practice; it’s about managing personalities, stamina, and knowing when to adapt exercises."

"There is a point where scaling back a workshop too much will make it ineffective and that trade-off must be explicit."

"Many stakeholders don’t inherently understand the difference in quality outcomes from workshops, so we must be explicit."

"Getting to know what people care about in the organization helps tailor workshops to support those goals and gain buy-in."

"It’s important to create a sincere environment where everyone feels they can equally participate, regardless of title or skill level."

Ask the Rosenbot
Michael Polivka
Scaling Design through Relationship Maps
2017 • DesignOps Summit 2017
Gold
Onur Kocan
Understanding the Strategy for Civic Design in a Complex City: Istanbul
2022 • Civic Design 2022
Gold
Tatyana Mamut
Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart
2019 • Enterprise Experience 2019
Gold
Adam Cutler
Discussion
2016 • Enterprise UX 2016
Gold
Mansi Gupta
Women-Centric Research: What, Why, How
2023 • Advancing Research 2023
Gold
Miles Orkin
Creativity and Culture
2018 • DesignOps Summit 2018
Gold
Jenny Price
From Tradition to Transformation: Unlocking Startup Agility in a Legacy Enterprise
2025 • DesignOps Summit 2025
Gold
Ashley Cortez
Shifting Toward Community-Led Innovation in Local Government
2021 • Civic Design 2021
Gold
Dana Chisnell
The Sensemaking Business
2026 • Advancing Research 2026
Gold
Jennifer Kong
Journeying toward AI-assisted documentation in healthcare
2024 • Designing with AI 2024
Gold
Kelly Goto
Emotion Economy: Ethnography as Corporate Strategy
2015 • Enterprise UX 2015
Gold
Hana Nagel
Turning Research Ripples into Waves
2018 • DesignOps Summit 2018
Gold
Jack Moffett
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
2022 • Enterprise Community
David Conrad
The Feeling of Data
2023 • Enterprise Community
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • DesignOps Summit 2022
Gold
Rachael Greene
Building a Design Ops Practice that Really Works (Most of the Time)
2025 • DesignOps Community

More Videos

Chelsea Mauldin

"We shifted from thinking of salary as an individual thing to thinking of revenue as a collective resource."

Chelsea Mauldin

Let's Talk About Money

November 17, 2022

Stephanie Wade

"As a contractor, use case studies and data-driven examples to paint the picture of what civic design can achieve even if you’re outside government."

Stephanie Wade

Building and Sustaining Design in Government

December 8, 2021

Kristin Wisnewski

"Fletcher Prevend took us to the next level by reporting design and user research directly into the CIO office—a huge differentiator."

Kristin Wisnewski

Measuring What Matters

October 23, 2019

Tala Tayebi

"We're structured like a dry cleaner—someone only thinks about research when they have a problem to solve."

Tala Tayebi Kelly Goto Jared Spool

Voice and influence in an age of noise

March 10, 2026

Eniola Oluwole

"TripAdvisor hasn’t had a design lead for about 1.5 years, leaving teams to work as individuals in silos with their own design systems."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Mark Interrante

"Assume positive intent from their point of view — they’re trying to have a good day, not work against you."

Mark Interrante

Collaboration Flows in Product Development

June 9, 2017

Nicole Bergstrom

"Centralizing budget and tools for accessibility helps build maturity and consistency across large organizations."

Nicole Bergstrom Anna Cook Kate Kalcevich Saara Kamppari-Miller

AccessibilityOps: Moving beyond “nice to have”

September 19, 2024

Spencer L. A. Stultz

"Making space for subculture to thrive is like letting more air and sunlight in, it creates a healthier environment for everyone."

Spencer L. A. Stultz

Why Social Justice Frameworks are Necessary for Successful DEI/JEDI Initiatives

October 4, 2023

Samuel Proulx

"We cannot change people, but we can change systems, processes, and environments."

Samuel Proulx

Invisible barriers: Why accessible service design can’t be an afterthought

December 3, 2024