Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Gold
Tuesday, March 28, 2023 • Advancing Research 2023
Share the love for this talk
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Speakers: Anne Mamaghani
Link:

Summary

Generative workshops are a critical generative component of any product development process. But in my 20+ years conducting product user research, I have seen more product harm come from so-called "workshops" or "design sprints" than good. In this tutorial, I will share more about my experience and what I've found are critical components of generative workshops -- whether they last five hours or five days. Contrary to popular belief, a design sprint is a highly structured and carefully designed series of exercises, not a brainstorm, design jam or free-for-all. The whole point is to drive a cross-functional team to the right outcome, and this requires a set of structured exercises which weave the thread of user needs, behaviors and attitudes throughout. This involves more than reviewing the research at the start and then moving on to create without that research in context. A true design sprint takes us from user insights -- even broad user insights -- to user-evaluated concepts or designs. The generative phase of a product is deeply impactful, and design sprints are a fantastic tool for driving this needed impact. However, many are practicing brainstorms or design jams rather than true design sprints. One can make a mismatched concept extremely usable throughout the product development process, but that will not remedy the fact that it is not the right concept. Researchers are ideal design sprint organizers and facilitators, but researchers are sometimes not even considered a critical component of the sprint. It's important for knowledgeable researchers to drive design sprint impact.

Key Insights

  • Many generative workshops fail due to fundamental mistakes more often than they succeed.

  • The 'Sprint as theater' mistake occurs when workshops are done for appearances or political reasons rather than genuine product development.

  • Well-structured workshops with specific exercises are crucial to move from research data to human-centered product concepts.

  • Integrating research both before and after a workshop grounds concepts in real human needs and allows recovery if initial research is missing.

  • Excluding key decision-makers leads to surprise blockers after workshops and risks misalignment with product goals.

  • Facilitation is a distinct, practiced skill essential to managing group dynamics, pacing, and adapting exercises during workshops.

  • Scaling back workshops too much compromises their effectiveness and the quality of resulting concepts.

  • Explicit communication about workshop outcomes and quality is necessary to help stakeholders appreciate the method's value.

  • Training facilitators in focused, incremental sessions delivers practical skills necessary for leading effective workshops.

  • Ensuring equal participation requires setting clear engagement rules and providing tool training to accommodate varying skill levels.

Notable Quotes

"The outcome of this method really makes the difference between lightning and a lightning bug."

"Sprint as theater is not going to result in a product concept that really represents human needs, behaviors, and attitudes."

"If there is no structured way to move from data to concept, you often end up with just a brainstorm, not a grounded concept."

"Lack of research before or after the workshop can be recovered from but at some cost to the concept’s validity."

"Excluding key people might save time but it often leads to surprise blockers and misaligned decisions later on."

"Facilitation is a skill that takes real practice; it’s about managing personalities, stamina, and knowing when to adapt exercises."

"There is a point where scaling back a workshop too much will make it ineffective and that trade-off must be explicit."

"Many stakeholders don’t inherently understand the difference in quality outcomes from workshops, so we must be explicit."

"Getting to know what people care about in the organization helps tailor workshops to support those goals and gain buy-in."

"It’s important to create a sincere environment where everyone feels they can equally participate, regardless of title or skill level."

Ask the Rosenbot
Jenny Price
From Tradition to Transformation: Unlocking Startup Agility in a Legacy Enterprise
2025 • DesignOps Summit 2025
Gold
Kelly Dern
AI as a Design Partner: How to Get the Most Out of AI Tools to Scale Your Process
2023 • DesignOps Summit 2023
Gold
Jorge Arango
The Best of Both Worlds: How to Integrate Paper and Digital Notes (1st of 3 seminars)
2024 • Rosenfeld Community
Louis Rosenfeld
Opening Remarks
2023 • Design in Product 2023
Gold
William Newton
How to Lead With Data, and Without Data
2023 • Enterprise UX 2023
Gold
Sarah Kinkade
Design Management Models in the Face of Transformation
2022 • Design at Scale 2022
Gold
Holly Cole
Panel Discussion: Growing People and Teams
2018 • DesignOps Summit 2018
Gold
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka
2021 • Civic Design Community
Ana Maria Montero Barrantes
The Authentic UX Talent Show
2024 • Enterprise Experience 2020
Gold
Eduardo Ortiz
Theme 3 Intro
2025 • Advancing Research 2025
Gold
Adam Thomas
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
2022 • Design in Product 2022
Gold
Kate Kalcevich
Designing inclusively with AI
2024 • Designing with AI 2024
Gold
Wendy Johansson
An Education on Design Education for Orgs
2021 • Design at Scale 2021
Gold
Chris Geison
Theme Two Intro
2023 • Advancing Research 2023
Gold
Patrick Commarford
Design Staffing for Impact
2024 • DesignOps Summit 2020
Gold
Uday Gajendar
Theme One Intro
2023 • Enterprise UX 2023
Gold

More Videos

Doug Powell

"Good design is good business."

Doug Powell

Closing Keynote: Design at Scale

November 8, 2018

Mila Kuznetsova

"A growth mindset in research means being ready to adapt protocols based on what actually works with participants."

Mila Kuznetsova Lucy Denton

How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices

March 9, 2022

Sarah Gallimore

"We created a Wizard of Oz smoke and mirrors prototype—a simple text message thread between a parent and this service—just to get enough buy-in."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Lada Gorlenko

"Junior team members don’t have to talk directly to executives; working effectively with peers can create grassroots buy-in."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Alnie Figueroa

"AI is here to stay, challenging our norms and shaping our future."

Alnie Figueroa

The Future of Design Operations: Transforming Our Craft

September 10, 2025

Landon Barnes

"You shouldn’t send another survey unless you’ve implemented changes and allowed time for behavior to adapt."

Landon Barnes

Are My Research Findings Actually Meaningful?

March 10, 2022

Emily Eagle

"It’s the worst thing when someone feels dumb in front of a customer because the tools don’t support them."

Emily Eagle

Can't Rewind: Radio and Retail

June 3, 2019

Malini Rao

"There is no solid way to control the course of your re-platforming project; being flexible is essential."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021

Asia Hoe

"Design is not just aesthetics; it’s about what the product feels like, sounds like, and how it differentiates in the market."

Asia Hoe

Partnering with Product: A Journey from Junior to Senior Design

November 29, 2023