Summary
Research and analytics are the eyes and ears of DesignOps. Validating whether strategies are effective or ineffective allows course correction and adaptation. Identifying problems that require action is essential for facilitating collaboration and ensuring that team members are engaged. Prioritizing user needs is the heart of user experience and Agile development. None of this can be done well without an effective research program. We’ll share how we scale research efforts to collect feedback from thousands of users per month and track the impact of dozens of projects involving 120+ designers.
Key Insights
-
•
IBM's CIO design team represents only 1% of the IT department but aims to support 385,000 IBMers.
-
•
The team emphasizes empathy in creating effective user experiences to meet the challenges posed by a rapidly changing workforce.
-
•
Over half of IBM's employees have been with the company for less than five years, making onboarding and user experience critical.
-
•
The design team's responsibilities extend beyond tools to influence culture and the physical work environment.
-
•
Continuous improvement and data-driven decision making are essential to enhance user experience at IBM.
-
•
Regular feedback from employees through systems like the Voice of Employee program helps in real-time adjustments to services.
-
•
Metrics such as Net Promoter Score (NPS) and goal completion rates guide the team's strategy and accountability.
-
•
A strong collaborative relationship among design, research, and operations teams ensures cohesive user experience improvements.
-
•
Keeping the user at the center is fundamental; measurement informs better service rather than just retroactively validating decisions.
-
•
Flexibility in processes and embracing chaos is necessary for growth in such a large organization.
Notable Quotes
"Our mission is to create a productive environment for IBMers, continuously improving the work experience."
"The state of IT is a daily reflection of what the company thinks and feels about its employees."
"We believe in measurement: what you measure is what improves."
"Every minute spent struggling with an IT system is a minute of time not spent delivering value for IBM and our clients."
"You cannot just focus on a single task; you must consider the entire ecosystem."
"We’ve learned to always be testing versus always be guessing."
"We're trying to influence the tone and culture of the company through design."
"What you measure is what improves, and we are ready to put those metrics out there for everyone to see."
"Data helps you make the right decision, not just support the decision that you've already made."
"As imperfect as NPS is, it's uniformly imperfect, and if you manipulate results, you're harming the entire system."
More Videos
"Diverse teams build diverse products"
Sam ProulxAccessibility: An Opportunity to Innovate
November 16, 2022
"Find your champion as high up in the company as possible; it makes a big difference."
Mike DavidsonFireside Chat
March 11, 2022
"Our hands make all of the things, and our brains form the teams that run the hand that makes the things."
Husani OakleyBias Towards Action: Building Teams that Build Work
June 14, 2018
"Our work allowed us to shift the conversation from aesthetics to measurable impact on the company's bottom line."
JD BuckleyCommunicating the ROI of UX within a large enterprise and out on the streets
June 14, 2018
"We're at a Rosenfeld Media conference on enterprise UX. Isn't life strange?"
Louis RosenfeldWelcome / Housekeeping
June 6, 2023
"Getting mad about not having a seat at the table isn't productive."
Brendan JarvisFraming Tomorrow by Questioning Today
June 8, 2022
"The goal of good design is to elevate experiences, remove friction, and empower user agency."
Josh Clark Veronika KindredSentient Design, AI, and the Radically Adaptive Experience (1st of 3 seminars)
January 15, 2025
"Implicit methods help us measure the user's gut feeling; they capture first impressions that are otherwise hidden."
Daniela Magaña Flores Ariane Rahn Jeff Ephraim BanderAhead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
March 10, 2022
"I learned to observe and ask questions to show empathy."
Darian DavisLessons from a Toxic Work Relationship
January 8, 2024
