Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Learning Velocity—The Insights Speedometer
Thursday, September 16, 2021 • Advancing Research Community
Share the love for this talk
Learning Velocity—The Insights Speedometer
Speakers: Jen Cardello and Jennifer Otto
Link:

Summary

Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.

Key Insights

  • Fidelity's UX research team faced huge scale challenges with 600+ product teams and only 35 researchers, making ubiquity impossible.

  • Focusing on research quantity, such as more studies faster, is counterproductive and considered poison; instead, learning velocity is the priority.

  • The democratization program trained over 200 designers and product partners to independently run unmoderated usability tests, cutting insight turnaround from 14 days to 3 days.

  • Quality control in democratization was ensured via a buddy system and approval gating in the testing platform to maintain high research standards.

  • Lighthouse centralized all UX research insights with strict standards on metadata and titling to reduce redundancy and make insights easily discoverable.

  • Lighthouse integration with collaboration tools like Microsoft Teams encouraged organic sharing and started building insight virality and empathy culture.

  • Continuous Discovery and Feedback (CDF) introduced a steady sprint cadence with dedicated researchers per initiative, aligned to living learning agendas prioritizing research questions.

  • CDF enabled transparency and cross-team collaboration, letting teams track when questions were posed and answered, speeding prioritization and strategic alignment.

  • Rapid recruiting innovations, including app push notifications and online scheduling, transformed a 4-6 week participant recruitment process down to hours or days.

  • Cultural acceptance was crucial; designers embraced democratization for autonomy and faster validation, while researchers accepted a shift from execution to facilitation roles.

Notable Quotes

"We cannot be everywhere. So is the goal to conduct more studies faster? And we said no, it’s not. That’s poison."

"The focus is on helping the organization learn faster to make smart, human-centered decisions."

"We had a backlog that made turnaround times at least 14 days; now teams can get answers within three days through democratization."

"Lighthouse reduces time spent searching for insights by having everything in one place."

"Democratization is about letting go of some research and enabling teams to learn from customers directly."

"The buddy system ensures quality by requiring study review and approval before launching."

"Continuous Discovery runs every two to three weeks with dedicated researchers tied to specific product journeys."

"Recruiting used to take 4 to 6 weeks; now, with app push notifications, we can fill interviews within an hour and a half."

"Designers want to learn how to do research because they get autonomy and faster feedback, not just waiting weeks."

"We shifted from an output mindset of how much work we do to an outcome mindset of the impact our work delivers."

Ask the Rosenbot
Alexia Cohen
Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona
2024 • Advancing Service Design 2024
Gold
Greg Petroff
Everything is About to Change: Software as Material
2016 • Enterprise UX 2016
Gold
Bria Alexander
OKRs—Helpful or Harmful?
2022 • DesignOps Community
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold
Nicole Wright
Democratizing Research at HoneyBook
2022 • Advancing Research 2022
Gold
Louis Rosenfeld
Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?
2024 • Rosenfeld Community
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Design at Scale 2022
Gold
Mariah Hay
BUILD: Discussion
2018 • Enterprise Experience 2018
Gold
Zariah Cameron
ReDesigning Wellbeing for Equitable Care in the Workplace
2024 • DesignOps Summit 2024
Gold
Emily Eagle
Can't Rewind: Radio and Retail
2019 • Enterprise Experience 2019
Gold
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold
Uday Gajendar
The Wicked Craft of Enterprise UX
2015 • Enterprise UX 2015
Gold
Louis Rosenfeld
GenAI for UXers: A Rosenbot Demo and Discussion
2025 • Designing with AI 2025
Gold
Aditi Ruiz
Pulse Check: Empathy Mapping Your Product Manager, Pt. 2
2022 • Design in Product 2022
Gold
Sandra Camacho
Creating More Bias-Proof Designs
2025 • Rosenfeld Community
Samuel Proulx
From Standards to Innovation: Why Inclusive Design Wins
2025 • DesignOps Summit 2025
Conference

More Videos

Mariah Hay

"Medical errors should rank as the third leading cause of death in the US, many influenced by software and communication failures."

Mariah Hay

Ethics in Tech Education: Designing to Provide Opportunity for All

June 14, 2018

Nicole Bergstrom

"If you want to work with Hilton, you have to bring accessibility to the table like security and privacy."

Nicole Bergstrom Anna Cook Kate Kalcevich Saara Kamppari-Miller

AccessibilityOps: Moving beyond “nice to have”

September 19, 2024

Jon Fukuda

"Growing a team of design ops managers that can fire on all these cylinders all at once."

Jon Fukuda

Theme One Intro

September 8, 2022

Mackenzie Cockram

"The new site had a 19% dropout rate compared to 32% on the old site, showing clear improvement."

Mackenzie Cockram Sara Branco Cunha Ian Franklin

Integrating Qualitative and Quantitative Research from Discovery to Live

December 16, 2022

Mujtaba Hameed

"Always design your high-impact slides for the busy executive in the back of a limo."

Mujtaba Hameed

Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research

March 26, 2024

Chris Geison

"Saying no to a research request is actually saying yes to better focused, higher impact work elsewhere."

Chris Geison

What is Research Strategy?

March 11, 2021

Suzan Bednarz

"We don't assume companies intentionally fail certain audiences; it’s often about awareness and lacking champions."

Suzan Bednarz Hilary Sunderland

AccessibilityOps for All

January 8, 2024

Adel Du Toit

"Managing Slack channels requires continuous gardening and removing excess channels to reduce noise and focus users."

Adel Du Toit

Get Your CFO To Say: 'Our Strategic Goal is User Obsession'

June 10, 2022

Sam Yen

"In a nuclear war, the only things that would survive on Earth would be cockroaches and these old SAP screens."

Sam Yen

Driving Organizational Change Through Design? Do more of this and less of that

June 9, 2017