Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Gold
Tuesday, March 28, 2023 • Advancing Research 2023
Share the love for this talk
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Speakers: Anne Mamaghani
Link:

Summary

Generative workshops are a critical generative component of any product development process. But in my 20+ years conducting product user research, I have seen more product harm come from so-called "workshops" or "design sprints" than good. In this tutorial, I will share more about my experience and what I've found are critical components of generative workshops -- whether they last five hours or five days. Contrary to popular belief, a design sprint is a highly structured and carefully designed series of exercises, not a brainstorm, design jam or free-for-all. The whole point is to drive a cross-functional team to the right outcome, and this requires a set of structured exercises which weave the thread of user needs, behaviors and attitudes throughout. This involves more than reviewing the research at the start and then moving on to create without that research in context. A true design sprint takes us from user insights -- even broad user insights -- to user-evaluated concepts or designs. The generative phase of a product is deeply impactful, and design sprints are a fantastic tool for driving this needed impact. However, many are practicing brainstorms or design jams rather than true design sprints. One can make a mismatched concept extremely usable throughout the product development process, but that will not remedy the fact that it is not the right concept. Researchers are ideal design sprint organizers and facilitators, but researchers are sometimes not even considered a critical component of the sprint. It's important for knowledgeable researchers to drive design sprint impact.

Key Insights

  • Many generative workshops fail due to fundamental mistakes more often than they succeed.

  • The 'Sprint as theater' mistake occurs when workshops are done for appearances or political reasons rather than genuine product development.

  • Well-structured workshops with specific exercises are crucial to move from research data to human-centered product concepts.

  • Integrating research both before and after a workshop grounds concepts in real human needs and allows recovery if initial research is missing.

  • Excluding key decision-makers leads to surprise blockers after workshops and risks misalignment with product goals.

  • Facilitation is a distinct, practiced skill essential to managing group dynamics, pacing, and adapting exercises during workshops.

  • Scaling back workshops too much compromises their effectiveness and the quality of resulting concepts.

  • Explicit communication about workshop outcomes and quality is necessary to help stakeholders appreciate the method's value.

  • Training facilitators in focused, incremental sessions delivers practical skills necessary for leading effective workshops.

  • Ensuring equal participation requires setting clear engagement rules and providing tool training to accommodate varying skill levels.

Notable Quotes

"The outcome of this method really makes the difference between lightning and a lightning bug."

"Sprint as theater is not going to result in a product concept that really represents human needs, behaviors, and attitudes."

"If there is no structured way to move from data to concept, you often end up with just a brainstorm, not a grounded concept."

"Lack of research before or after the workshop can be recovered from but at some cost to the concept’s validity."

"Excluding key people might save time but it often leads to surprise blockers and misaligned decisions later on."

"Facilitation is a skill that takes real practice; it’s about managing personalities, stamina, and knowing when to adapt exercises."

"There is a point where scaling back a workshop too much will make it ineffective and that trade-off must be explicit."

"Many stakeholders don’t inherently understand the difference in quality outcomes from workshops, so we must be explicit."

"Getting to know what people care about in the organization helps tailor workshops to support those goals and gain buy-in."

"It’s important to create a sincere environment where everyone feels they can equally participate, regardless of title or skill level."

Ask the Rosenbot
Dan Willis
Theme 3: Intro
2024 • Enterprise Experience 2020
Gold
Matt Webb
Context Window: Five Futures for AI
2025 • Designing with AI 2025
Gold
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2019 • Enterprise Experience 2019
Gold
Stephen Pollard
Closing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
2017 • DesignOps Summit 2017
Gold
Tracy McGoldrick
IBM User Experience Program—The What, Why and How
2021 • Advancing Research Community
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
Katie Hansen
Finding the unknown in the known: Harnessing meta-analysis and literature review
2025 • Advancing Research 2025
Gold
Nathan Curtis
Design Systems for Us: How Many One-Source(s)-of-Truth Are Enough?
2019 • DesignOps Community
Ned Dwyer
Right horses for the right courses – how and when to democratize research
2025 • Advancing Service Design 2025
Gold
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Matt Duignan
Atomizing Research: Trend or Trap
2020 • Advancing Research 2020
Gold
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Alana Washington
(Remote) Service Design: A Transformation Case Study
2022 • Design at Scale 2022
Gold
Jennifer Strickland
Adopting a "Design By" Method
2021 • Civic Design 2021
Gold
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold
Kristen Honey
"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design
2021 • Civic Design Community

More Videos

Emily Eagle

"We have the Big C and the Little C: our external customers and our salespeople using the tools every day."

Emily Eagle

Can't Rewind: Radio and Retail

June 3, 2019

Dawn Ressel

"Widgets encapsulate a user task with associated user interface and back end service functionality."

Dawn Ressel

Full-Stack User Experiences: A Marriage of Design and Technology

June 9, 2016

Kurt McCulloch

"We’re not just translators between different ways of thinking, but architects of shared reasoning processes."

Kurt McCulloch

Faster alone, further together: Rebuilding collaboration in the age of AI research

March 10, 2026

Sheryl Cababa

"The organization’s website structure often mirrors its internal organizational structure and decision-making."

Sheryl Cababa Alexis Oh

Thinking in systems to address climate with Sheryl Cababa

June 12, 2024

Bill Scott

"Engineering’s number one goal should be to enable learning."

Bill Scott

Lean Engineering: Engineering for Learning and Experimentation in the Enterprise

May 14, 2015

Uday Gajendar

"That seven-foot-wide diagram was our product, not just the cleaned-up UI screens—this artifact triggered a whole new conversation."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Ed Mullen

"Improving developer experience starts with understanding users and their technical contexts."

Ed Mullen

Designing the Unseen: Enabling Institutions to Build Public Trust

November 16, 2022

Maria Giudice

"Nobody wants to be told to do your thing unless it’s clear that it helps their thing. It’s just human nature."

Maria Giudice

Becoming a Changemaker by Leading with Design

March 29, 2023

Tutti Taygerly

"Share your story vulnerably and in a neutral setting to open connection."

Tutti Taygerly

Videconference: How to Work with Difficult People with Tutti Taygerly

June 25, 2020