Rosenverse
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right

Gold
Tuesday, March 28, 2023 • Advancing Research 2023
Share the love for this talk
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Speakers: Anne Mamaghani
Link:

Summary

Generative workshops are a critical generative component of any product development process. But in my 20+ years conducting product user research, I have seen more product harm come from so-called "workshops" or "design sprints" than good. In this tutorial, I will share more about my experience and what I've found are critical components of generative workshops -- whether they last five hours or five days. Contrary to popular belief, a design sprint is a highly structured and carefully designed series of exercises, not a brainstorm, design jam or free-for-all. The whole point is to drive a cross-functional team to the right outcome, and this requires a set of structured exercises which weave the thread of user needs, behaviors and attitudes throughout. This involves more than reviewing the research at the start and then moving on to create without that research in context. A true design sprint takes us from user insights -- even broad user insights -- to user-evaluated concepts or designs. The generative phase of a product is deeply impactful, and design sprints are a fantastic tool for driving this needed impact. However, many are practicing brainstorms or design jams rather than true design sprints. One can make a mismatched concept extremely usable throughout the product development process, but that will not remedy the fact that it is not the right concept. Researchers are ideal design sprint organizers and facilitators, but researchers are sometimes not even considered a critical component of the sprint. It's important for knowledgeable researchers to drive design sprint impact.

Key Insights

  • •

    Many generative workshops fail due to fundamental mistakes more often than they succeed.

  • •

    The 'Sprint as theater' mistake occurs when workshops are done for appearances or political reasons rather than genuine product development.

  • •

    Well-structured workshops with specific exercises are crucial to move from research data to human-centered product concepts.

  • •

    Integrating research both before and after a workshop grounds concepts in real human needs and allows recovery if initial research is missing.

  • •

    Excluding key decision-makers leads to surprise blockers after workshops and risks misalignment with product goals.

  • •

    Facilitation is a distinct, practiced skill essential to managing group dynamics, pacing, and adapting exercises during workshops.

  • •

    Scaling back workshops too much compromises their effectiveness and the quality of resulting concepts.

  • •

    Explicit communication about workshop outcomes and quality is necessary to help stakeholders appreciate the method's value.

  • •

    Training facilitators in focused, incremental sessions delivers practical skills necessary for leading effective workshops.

  • •

    Ensuring equal participation requires setting clear engagement rules and providing tool training to accommodate varying skill levels.

Notable Quotes

"The outcome of this method really makes the difference between lightning and a lightning bug."

"Sprint as theater is not going to result in a product concept that really represents human needs, behaviors, and attitudes."

"If there is no structured way to move from data to concept, you often end up with just a brainstorm, not a grounded concept."

"Lack of research before or after the workshop can be recovered from but at some cost to the concept’s validity."

"Excluding key people might save time but it often leads to surprise blockers and misaligned decisions later on."

"Facilitation is a skill that takes real practice; it’s about managing personalities, stamina, and knowing when to adapt exercises."

"There is a point where scaling back a workshop too much will make it ineffective and that trade-off must be explicit."

"Many stakeholders don’t inherently understand the difference in quality outcomes from workshops, so we must be explicit."

"Getting to know what people care about in the organization helps tailor workshops to support those goals and gain buy-in."

"It’s important to create a sincere environment where everyone feels they can equally participate, regardless of title or skill level."

Ask the Rosenbot
Saara Kamppari-Miller
"Prototype" vs "Prototype"--Breaking Down and Rebuilding Our Understanding of What We Do
2019 • DesignOps Summit 2019
Gold
Sam Ladner
How Research Can Drive Strategic Foresight
2022 • Advancing Research 2022
Gold
Darian Davis
Lessons from a Toxic Work Relationship
2024 • Enterprise Experience 2020
Gold
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
Cheryl Platz
Collaborative Creativity through Improv
2018 • DesignOps Summit 2018
Gold
Maria Taylor
Knowledge is Power: Managing the Lifeblood of the Design Org
2023 • DesignOps Summit 2023
Gold
Anna Nguyen
Why Our Voice of the Customer is Better Than Yours
2022 • Advancing Research 2022
Gold
Gillian Salerno-Rebic
From Insight to Impact: How JourneySpark Used WEVO Pulse + Pro to Drive a 50% Lift in Ad Engagement
2025 • Designing with AI 2025
Gold
Courtney Kaplan
Taking it to the next level: Career paths in DesignOps
2018 • DesignOps Summit 2018
Gold
Scott Jensen
Short Take #2: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Dagmara Kukawka
Tiny team, moonshot impact: Democratizing research across continents
2026 • Advancing Research 2026
Gold
Amanda Kaleta-Kott
The Joys and Dilemmas of Conducting UX Research with Older Adults
2022 • Advancing Research 2022
Gold
Zariah Cameron
ReDesigning Wellbeing for Equitable Care in the Workplace
2024 • DesignOps Summit 2024
Gold
Sharbani Dhar
Breathing Room for Delight
2024 • Enterprise Experience 2020
Gold
Leah Buley
Closing Plenary: The Crisis of Digital
2020 • Advancing Research 2020
Gold
Courtney Maya George
Scale Your Organization and Grow Your Designers
2022 • DesignOps Summit 2022
Gold

More Videos

Deanna Mitchell

"Everybody plays games whether they self-identify as a gamer or not."

Deanna Mitchell

Designing with culture: Unlocking impactful insights for Product and UX

March 12, 2025

Adam Cutler

"The IBM design language is about system unity instead of uniformity, so designers aren’t cookie cutters."

Adam Cutler

People + Places + Practices = Outcomes

June 8, 2016

Sam Proulx

"Getting accessibility integrated into all company processes is essential because accessibility is a culture change."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

June 6, 2023

Shazia Ali

"We have a responsibility to present back the voice of the consumers and make sure it feeds into strategy."

Shazia Ali Bruce Gillespie Joyce Lee Andy Warr

Communication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]

August 21, 2024

Bria Alexander

"The waters of operations can feel incredibly murky and the path forward may not always be clear."

Bria Alexander

Theme Two Intro

September 8, 2022

Saara Kamppari-Miller

"We want everyone adopting these inclusive design and research practices—not just a few advanced teams."

Saara Kamppari-Miller

Inclusive Design is DesignOps

September 29, 2021

Louis Rosenfeld

"Books are semantically very rich and thus pull content much more effectively in our vector database than conference talks."

Louis Rosenfeld Peter Van Dijck

GenAI for UXers: A Rosenbot Demo and Discussion

September 11, 2025

Ovetta Sampson

"Speculative research requires participatory methods, putting people into future scenarios, because people often can't articulate what they will want."

Ovetta Sampson

Research in the Automated Future

March 11, 2022

Lisa Spitz

"Every single thing that we would plan to say to the participant is spelled out in this interview guide to build transparency and trust."

Lisa Spitz Nikki Brand

Building Trust Through Equitable Research Practices

November 18, 2022