Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

IBM User Experience Program—The What, Why and How
Friday, October 15, 2021 • Advancing Research Community
Share the love for this talk
IBM User Experience Program—The What, Why and How
Speakers: Tracy McGoldrick
Link:

Summary

How does IBM co-create with our end-users to design products they love? Learn how the IBM Cloud and AI research team created a User Experience Program that formalizes and scales the relationship between our product teams and the end-users. User Experience “Partners,” as we lovingly call them, co-create with our product team to help refine IBM products by providing feedback, ideas, and domain expertise.

Key Insights

  • IBM’s User Experience Program involves long-term partnerships (often 1-2 years) with customers for ongoing, strategic feedback rather than one-off sessions.

  • Customers in the program are called User Experience Partners and do not receive incentives, unlike traditional research participants.

  • Effective recruitment relies heavily on internal stakeholders like sales and account managers to identify and connect with the right customers.

  • Diversity and inclusion remain key priorities; IBM has launched initiatives specifically to recruit partners with diverse abilities and backgrounds.

  • A slender core team led by Tracy manages over 700 active user partners globally, requiring scalable processes and collaboration from multiple program managers.

  • IBM uses a robust, self-service research repository built on Airtable to track participants, research activities, and avoid over-engagement.

  • Communication with partners is highly personalized including quarterly playback meetings where customers discuss roadmaps and past feedback impacts directly with product teams.

  • Legal and data privacy challenges are complex, especially with multinational customers, requiring evergreen feedback agreements and GDPR-compliant consent forms.

  • Measuring program impact ties into IBM’s overall business objectives and benefits from customers advocating for the program internally.

  • The User Experience Program acts like an advisory board, helping IBM anticipate future needs beyond immediate usability issues, fueling innovation.

Notable Quotes

"Yesterday was a prototype – we are continually redesigning around our users’ needs."

"Our user experience partners co-create with product teams to help refine IBM products."

"We don’t promise that every piece of feedback will show up in the product, but we keep partners informed about how their input influences development."

"Recruiting diverse partners takes time and effort, and we are actively building programs to include people with diverse abilities."

"It’s like sending around the Rolls Royce with the champagne bottle – a white glove, concierge service for recruiting partners."

"We have a feedback program agreement that once signed, is evergreen and covers everyone in the customer’s company."

"We’re very careful about PII and only the lead researcher and research ops managers have access to sensitive data."

"Customers in the program become our greatest source of learning and help shape the future of our products."

"Getting internal teams on board is often the biggest challenge, but once they see the value, it lights a fire."

"We don’t need to convince executives of the program’s value – our customers do that for us."

Ask the Rosenbot
Jackie Ho
Lead Effectively While Preserving Team Autonomy with Growth Boards
2024 • Enterprise Experience 2020
Gold
Bassel Deeb
Do More With Less: Equip and Lead Design Orgs Through Adversity
2023 • DesignOps Summit 2023
Gold
Lija Hogan
Doing more with more: Lessons from the Front Lines of Democratization
2022 • Advancing Research 2022
Gold
Joi Freeman
A New Vantage Point: Building a Pipeline for Multifaceted Research(ers)
2020 • Advancing Research 2020
Gold
Tess Dixon
C'mon Get Happy
2021 • DesignOps Summit 2021
Gold
Laura Weiss
Turn Down the Heat: 3 Ways to Handle Conflict in the Moment
2024 • Rosenfeld Community
Noel Lamb
Cultivating Business Partnerships to Grow Research Ops
2022 • Advancing Research Community
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Matteo Gratton
Can Data and Ethics Live Together?
2021 • DesignOps Summit 2021
Gold
Frances Yllana
DesignOps–Leading the Path to Parity
2023 • DesignOps Community
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
John Taschek
Making People the X-Factor in the Enterprise
2018 • Enterprise Experience 2018
Gold
Louis Rosenfeld
The Bigger Picture: A Panel Discussion
2019 • DesignOps Summit 2019
Gold
Emilia Åström
Unlock Your Team’s Intelligence with Collaboration Design
2022 • Design at Scale 2022
Gold
Julie Norvaisas
Back to basics, or start from scratch?
2025 • Advancing Research 2025
Gold
Rob Mitzel
The Tale of Two Companies: Building a Successful UX Practice in a Century-Old Enterprise
2024 • Enterprise Experience 2020
Gold

More Videos

Brian T. O’Neill

"Not everyone using machine learning is your user; think also about the people labeling the data feeding these models."

Brian T. O’Neill Maria Cipollone Luis Colin Manuel Dahm Mike Oren

Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?

February 18, 2022

Jorge Arango

"I used GPT-4 to retag 1,200 blog posts, reducing an estimated 10–12 hours of tedious manual work to about a third of that time."

Jorge Arango

Scale Smart: AI-Powered Content Organization Strategies

September 24, 2024

Bria Alexander

"We have over a thousand members in the #do-general Slack channel, and that’s where the party is at."

Bria Alexander

Opening Remarks

October 1, 2021

Louis Rosenfeld

"Our curators have been working for months taking presentations from little ideas to something big that advances design ops as practice."

Louis Rosenfeld Bria Alexander

Day 1 Welcome

September 23, 2024

Mansi Gupta

"Male universality is one of the leading causes of gender gaps."

Mansi Gupta

Women-Centric Research: What, Why, How

March 29, 2023

Bria Alexander

"You don’t have to take notes; session videos and decks will be shared as soon as possible."

Bria Alexander

Opening Remarks

October 3, 2023

Andy Polaine

"Product has really understood what makes businesses tick and how to take accountability and get mandate."

Andy Polaine Lavrans Løvlie

What is the role of service design in product-led organizations?

December 3, 2024

George Abraham

"Your main app stays stable on the main branch, and the app builder changes live on separate branches for safe developer review."

George Abraham Stefan Ivanov

Design Systems To-Go: Indigo.Design Overview and Exploring the Developer Workflow (Part 3)

October 1, 2021

Robin Beers

"Power core is where senior executives really care about outcomes or functions that hold power."

Robin Beers

Beyond Insights: Researchers as Organizational Change Catalysts

March 25, 2024