Rosenverse
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right

Gold
Tuesday, March 28, 2023 • Advancing Research 2023
Share the love for this talk
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Speakers: Anne Mamaghani
Link:

Summary

Generative workshops are a critical generative component of any product development process. But in my 20+ years conducting product user research, I have seen more product harm come from so-called "workshops" or "design sprints" than good. In this tutorial, I will share more about my experience and what I've found are critical components of generative workshops -- whether they last five hours or five days. Contrary to popular belief, a design sprint is a highly structured and carefully designed series of exercises, not a brainstorm, design jam or free-for-all. The whole point is to drive a cross-functional team to the right outcome, and this requires a set of structured exercises which weave the thread of user needs, behaviors and attitudes throughout. This involves more than reviewing the research at the start and then moving on to create without that research in context. A true design sprint takes us from user insights -- even broad user insights -- to user-evaluated concepts or designs. The generative phase of a product is deeply impactful, and design sprints are a fantastic tool for driving this needed impact. However, many are practicing brainstorms or design jams rather than true design sprints. One can make a mismatched concept extremely usable throughout the product development process, but that will not remedy the fact that it is not the right concept. Researchers are ideal design sprint organizers and facilitators, but researchers are sometimes not even considered a critical component of the sprint. It's important for knowledgeable researchers to drive design sprint impact.

Key Insights

  • Many generative workshops fail due to fundamental mistakes more often than they succeed.

  • The 'Sprint as theater' mistake occurs when workshops are done for appearances or political reasons rather than genuine product development.

  • Well-structured workshops with specific exercises are crucial to move from research data to human-centered product concepts.

  • Integrating research both before and after a workshop grounds concepts in real human needs and allows recovery if initial research is missing.

  • Excluding key decision-makers leads to surprise blockers after workshops and risks misalignment with product goals.

  • Facilitation is a distinct, practiced skill essential to managing group dynamics, pacing, and adapting exercises during workshops.

  • Scaling back workshops too much compromises their effectiveness and the quality of resulting concepts.

  • Explicit communication about workshop outcomes and quality is necessary to help stakeholders appreciate the method's value.

  • Training facilitators in focused, incremental sessions delivers practical skills necessary for leading effective workshops.

  • Ensuring equal participation requires setting clear engagement rules and providing tool training to accommodate varying skill levels.

Notable Quotes

"The outcome of this method really makes the difference between lightning and a lightning bug."

"Sprint as theater is not going to result in a product concept that really represents human needs, behaviors, and attitudes."

"If there is no structured way to move from data to concept, you often end up with just a brainstorm, not a grounded concept."

"Lack of research before or after the workshop can be recovered from but at some cost to the concept’s validity."

"Excluding key people might save time but it often leads to surprise blockers and misaligned decisions later on."

"Facilitation is a skill that takes real practice; it’s about managing personalities, stamina, and knowing when to adapt exercises."

"There is a point where scaling back a workshop too much will make it ineffective and that trade-off must be explicit."

"Many stakeholders don’t inherently understand the difference in quality outcomes from workshops, so we must be explicit."

"Getting to know what people care about in the organization helps tailor workshops to support those goals and gain buy-in."

"It’s important to create a sincere environment where everyone feels they can equally participate, regardless of title or skill level."

Ask the Rosenbot
Craig Villamor
Design Systems for Ethical Design
2023 • Enterprise Community
Chris Govias
Perspectives on Civic Design
2021 • Civic Design Community
Russell Blair
Killing the blank page
2024 • Designing with AI 2024
Gold
Louis Rosenfeld
How to use the Rosenbot
2026 • Rosenfeld Community
Amber Knabl
Empowering innovation: The critical role of inclusive product development in the AI era
2024 • Designing with AI 2024
Gold
Cennydd Bowles
Day 1 Panel
2024 • Designing with AI 2024
Gold
Jaskiran Kang
Why Community is Key to Professionalizing Design
2022 • Civic Design Community
Amy Evans
How to Create Change
2024 • DesignOps Summit 2024
Gold
Matteo Gratton
Can Data and Ethics Live Together?
2021 • DesignOps Summit 2021
Gold
Jemma Ahmed
Theme 2 Intro
2022 • Advancing Research 2022
Gold
Dan Willis
Theme 3: Intro
2024 • Enterprise Experience 2020
Gold
Isaac Heyveld
Expand DesignOps Leadership as a Chief of Staff
2022 • DesignOps Summit 2022
Gold
Dana Bishop
2022: The Year UX Demonstrates its Business Impact
2022 • Advancing Research 2022
Gold
Roy Opata Olende
How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users
2020 • Advancing Research Community
Kelly Goto
Emotion Economy: Ethnography as Corporate Strategy
2015 • Enterprise UX 2015
Gold
The AI + Design wave has arrived: Making sense of the 2026 AI + Design Report
2026 • Rosenfeld Community

More Videos

Rachael Dietkus, LCSW

"Assume everybody has the potential for trauma to show up in any interaction you have with them."

Rachael Dietkus, LCSW Uday Gajendar Dr. Dawn Emerick Dawn E. Shedrick, LCSW

Leading through the long tail of trauma

July 7, 2022

Sheryl Cababa

"Ethics is not just about compliance; it’s about doing the right thing holistically."

Sheryl Cababa Ethan Marcotte Milena Pribic

Day 2 Panel

June 5, 2024

Erin Weigel

"If a problem keeps coming up, it’s usually the execution of the idea that’s failing, not the concept."

Erin Weigel

UX Lessons from running more than 1,200 A/B Tests

July 10, 2024

Dante Guintu

"The hardest lesson is being comfortable when you're uncomfortable and finding the best use of your time to create impact."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Alla Weinberg

"Meetings tell us what kind of conversations we are having and what kind of conversations we are not having."

Alla Weinberg

How to Build and Scale Team Safety

January 8, 2024

Ivana Ng

"If we can teach government partners to be product thinkers, that results in impact that lasts beyond contracts."

Ivana Ng

Level Up Your Program with ProductOps

January 8, 2024

Bria Alexander

"If you want to take notes during this presentation, there’s really no need — we’ve got you covered."

Bria Alexander

Opening Remarks

June 10, 2021

Matteo Gratton

"Tracking users without their understanding breaks the trust we need to build ethical products."

Matteo Gratton

Can Data and Ethics Live Together?

October 1, 2021

Eniola Oluwole

"Everyone wanted to know what the official pattern was, so they could have confidence that they were using the right one."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019