Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
How does IBM co-create with our end-users to design products they love? Learn how the IBM Cloud and AI research team created a User Experience Program that formalizes and scales the relationship between our product teams and the end-users. User Experience “Partners,” as we lovingly call them, co-create with our product team to help refine IBM products by providing feedback, ideas, and domain expertise.
Key Insights
-
•
IBM’s User Experience Program involves long-term partnerships (often 1-2 years) with customers for ongoing, strategic feedback rather than one-off sessions.
-
•
Customers in the program are called User Experience Partners and do not receive incentives, unlike traditional research participants.
-
•
Effective recruitment relies heavily on internal stakeholders like sales and account managers to identify and connect with the right customers.
-
•
Diversity and inclusion remain key priorities; IBM has launched initiatives specifically to recruit partners with diverse abilities and backgrounds.
-
•
A slender core team led by Tracy manages over 700 active user partners globally, requiring scalable processes and collaboration from multiple program managers.
-
•
IBM uses a robust, self-service research repository built on Airtable to track participants, research activities, and avoid over-engagement.
-
•
Communication with partners is highly personalized including quarterly playback meetings where customers discuss roadmaps and past feedback impacts directly with product teams.
-
•
Legal and data privacy challenges are complex, especially with multinational customers, requiring evergreen feedback agreements and GDPR-compliant consent forms.
-
•
Measuring program impact ties into IBM’s overall business objectives and benefits from customers advocating for the program internally.
-
•
The User Experience Program acts like an advisory board, helping IBM anticipate future needs beyond immediate usability issues, fueling innovation.
Notable Quotes
"Yesterday was a prototype – we are continually redesigning around our users’ needs."
"Our user experience partners co-create with product teams to help refine IBM products."
"We don’t promise that every piece of feedback will show up in the product, but we keep partners informed about how their input influences development."
"Recruiting diverse partners takes time and effort, and we are actively building programs to include people with diverse abilities."
"It’s like sending around the Rolls Royce with the champagne bottle – a white glove, concierge service for recruiting partners."
"We have a feedback program agreement that once signed, is evergreen and covers everyone in the customer’s company."
"We’re very careful about PII and only the lead researcher and research ops managers have access to sensitive data."
"Customers in the program become our greatest source of learning and help shape the future of our products."
"Getting internal teams on board is often the biggest challenge, but once they see the value, it lights a fire."
"We don’t need to convince executives of the program’s value – our customers do that for us."
Or choose a question:
More Videos
"People always move the chair slightly when they sit down for that small exercising of control or agency."
Sha HwangThe First Fifty Years of Civic Design
November 16, 2022
"With Draw Dream, the AI acts as a muse, giving inspiration but not the final outcome."
Lukas Moro“Feels Like Paper!”: Interfacing AI through Paper
June 11, 2025
"City Hall is often risk-averse, and professionals of color face extra penalties for taking risks in their careers."
Justin Entzminger Terrance Smith Tracy M. Colunga Mai-Ling GarciaRisk and Reward: How to Diversify the Field of Civic Innovators and Designers
November 17, 2022
"We realized designing for AI is very different from other computational mediums we used before."
Aras BilgenWho does the math: A designer’s journey in building an AI-based tutoring app
June 10, 2025
"Foresight is a team sport—the more perspectives you have, the better your future scenarios become."
April ReaganLook, Think, Act: The Futures-Smart Design Organization
October 1, 2021
"LLMs judging other LLMs might sound crazy, but if you do it right, it works."
Peter Van DijckHands-on AI #1: Let’s write your first AI eval
October 8, 2025
"The financial health network found that 72% of the population is either coping or vulnerable financially."
Yasmine KhanChecking Bias and Listening to Financially Vulnerable Americans
March 30, 2020
"Authentic leaders tell you why you are here before telling you what to do or how to do it."
Iram ShahClosing Keynote: The View from the Top
June 4, 2019
"One should work what needs to be done into what's already existing and let that carry the movement forward."
Sarah Alvarado Nalini P. Kotamraju Anne Mamaghani Peter MerholzHow to make UX research leadership more effective [Advancing Research Community Workshop Series]
October 26, 2023