Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Gold
Tuesday, March 28, 2023 • Advancing Research 2023
Share the love for this talk
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Speakers: Anne Mamaghani
Link:

Summary

Generative workshops are a critical generative component of any product development process. But in my 20+ years conducting product user research, I have seen more product harm come from so-called "workshops" or "design sprints" than good. In this tutorial, I will share more about my experience and what I've found are critical components of generative workshops -- whether they last five hours or five days. Contrary to popular belief, a design sprint is a highly structured and carefully designed series of exercises, not a brainstorm, design jam or free-for-all. The whole point is to drive a cross-functional team to the right outcome, and this requires a set of structured exercises which weave the thread of user needs, behaviors and attitudes throughout. This involves more than reviewing the research at the start and then moving on to create without that research in context. A true design sprint takes us from user insights -- even broad user insights -- to user-evaluated concepts or designs. The generative phase of a product is deeply impactful, and design sprints are a fantastic tool for driving this needed impact. However, many are practicing brainstorms or design jams rather than true design sprints. One can make a mismatched concept extremely usable throughout the product development process, but that will not remedy the fact that it is not the right concept. Researchers are ideal design sprint organizers and facilitators, but researchers are sometimes not even considered a critical component of the sprint. It's important for knowledgeable researchers to drive design sprint impact.

Key Insights

  • Many generative workshops fail due to fundamental mistakes more often than they succeed.

  • The 'Sprint as theater' mistake occurs when workshops are done for appearances or political reasons rather than genuine product development.

  • Well-structured workshops with specific exercises are crucial to move from research data to human-centered product concepts.

  • Integrating research both before and after a workshop grounds concepts in real human needs and allows recovery if initial research is missing.

  • Excluding key decision-makers leads to surprise blockers after workshops and risks misalignment with product goals.

  • Facilitation is a distinct, practiced skill essential to managing group dynamics, pacing, and adapting exercises during workshops.

  • Scaling back workshops too much compromises their effectiveness and the quality of resulting concepts.

  • Explicit communication about workshop outcomes and quality is necessary to help stakeholders appreciate the method's value.

  • Training facilitators in focused, incremental sessions delivers practical skills necessary for leading effective workshops.

  • Ensuring equal participation requires setting clear engagement rules and providing tool training to accommodate varying skill levels.

Notable Quotes

"The outcome of this method really makes the difference between lightning and a lightning bug."

"Sprint as theater is not going to result in a product concept that really represents human needs, behaviors, and attitudes."

"If there is no structured way to move from data to concept, you often end up with just a brainstorm, not a grounded concept."

"Lack of research before or after the workshop can be recovered from but at some cost to the concept’s validity."

"Excluding key people might save time but it often leads to surprise blockers and misaligned decisions later on."

"Facilitation is a skill that takes real practice; it’s about managing personalities, stamina, and knowing when to adapt exercises."

"There is a point where scaling back a workshop too much will make it ineffective and that trade-off must be explicit."

"Many stakeholders don’t inherently understand the difference in quality outcomes from workshops, so we must be explicit."

"Getting to know what people care about in the organization helps tailor workshops to support those goals and gain buy-in."

"It’s important to create a sincere environment where everyone feels they can equally participate, regardless of title or skill level."

Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • DesignOps Summit 2025
Conference
Harry Max
Failure Friday #5: Lessons from a SaaS Design Failure
2025 • Rosenfeld Community
Emily Lessard
RFPs Without Tears: Writing Inclusive RFPS that Don't Scare Away Talent
2021 • Civic Design 2021
Gold
James Lang
If you can design an app, you can design a community
2025 • Rosenfeld Community
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Civic Design 2022
Gold
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold
Christian Bason
Innovating With People: Unleashing the Potential of Civic Design
2021 • Civic Design 2021
Gold
Lavy Kumar
Future of Work
2021 • Design at Scale 2021
Gold
Ricardo Martins
Unlocking the power of advanced quantitative methods
2025 • Advancing Research 2025
Gold
Gretchen Anderson
Scaling the Human Center
2017 • Enterprise Experience 2017
Gold
Kristin Skinner
Theme 2: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Jen Cardello
Standardizing Product Merits for Leaders, Designers, and Everyone
2018 • Enterprise Experience 2018
Gold
Jorge Arango
Scale Smart: AI-Powered Content Organization Strategies
2024 • DesignOps Summit 2024
Gold
Anna Poznyakov
Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact
2021 • Advancing Research 2021
Gold
Prerna Makanawala
Achieving Balanced Design Consistency
2021 • Design at Scale 2021
Gold

More Videos

Etienne Fang

"Uber bus drivers in Cairo end up working longer than their scheduled shift because they still receive requests 20 to 30 minutes before their shift ends."

Etienne Fang

Power of Insights: Why sharing is better than silos with Uber’s Insights Platform

December 16, 2019

Victor M. Gonzalez

"Universities in Latin America are doing a very bad job providing practical UX research training."

Victor M. Gonzalez

Practicing Learners and Learning Practitioners

March 10, 2021

Roberta Dombrowski

"Collaboration helps you look at problems from different angles, which makes your work more robust and nuanced."

Roberta Dombrowski Sam Duong Woloszynski

Making Research a Team Sport

March 11, 2022

Daniel J. Rosenberg

"A lot of these companies have founders or investors who are themselves doctors or diabetic patients."

Daniel J. Rosenberg

Digital Medicine Design

September 26, 2019

Jaime Creixems

"Leave some space for creativity in your design system so designers can innovate without breaking consistency."

Jaime Creixems

Best Practices when Creating and Maintaining a Design System

June 7, 2023

Tricia Wang

"Thick data is the opposite of big data and essential for rescuing lost context."

Tricia Wang

From Users to Shapers of AI: The Future of Research

March 25, 2024

Shahrzad Samadzadeh

"Some situations are not worth saving. If you have no champion, no clarity, and no purpose, is it worth it to continue?"

Shahrzad Samadzadeh

What Is My Value? Two Takes and Some Mistakes

January 8, 2024

Jorge Arango

"Design is a third way of knowing, different from science and humanities, involving making and artifice."

Jorge Arango

Design as an Antidote to VUCA

May 9, 2019

Louis Rosenfeld

"Slack is growing steadily for us, but it’s hard to moderate and expensive at scale."

Louis Rosenfeld

The Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld

June 5, 2024