Rosenverse
Learning Velocity—The Insights Speedometer

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Learning Velocity—The Insights Speedometer

Thursday, September 16, 2021 • Advancing Research Community
Share the love for this talk
Learning Velocity—The Insights Speedometer
Speakers: Jen Cardello and Jennifer Otto
Link:

Summary

Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.

Key Insights

  • Fidelity's UX research team faced huge scale challenges with 600+ product teams and only 35 researchers, making ubiquity impossible.

  • Focusing on research quantity, such as more studies faster, is counterproductive and considered poison; instead, learning velocity is the priority.

  • The democratization program trained over 200 designers and product partners to independently run unmoderated usability tests, cutting insight turnaround from 14 days to 3 days.

  • Quality control in democratization was ensured via a buddy system and approval gating in the testing platform to maintain high research standards.

  • Lighthouse centralized all UX research insights with strict standards on metadata and titling to reduce redundancy and make insights easily discoverable.

  • Lighthouse integration with collaboration tools like Microsoft Teams encouraged organic sharing and started building insight virality and empathy culture.

  • Continuous Discovery and Feedback (CDF) introduced a steady sprint cadence with dedicated researchers per initiative, aligned to living learning agendas prioritizing research questions.

  • CDF enabled transparency and cross-team collaboration, letting teams track when questions were posed and answered, speeding prioritization and strategic alignment.

  • Rapid recruiting innovations, including app push notifications and online scheduling, transformed a 4-6 week participant recruitment process down to hours or days.

  • Cultural acceptance was crucial; designers embraced democratization for autonomy and faster validation, while researchers accepted a shift from execution to facilitation roles.

Notable Quotes

"We cannot be everywhere. So is the goal to conduct more studies faster? And we said no, it’s not. That’s poison."

"The focus is on helping the organization learn faster to make smart, human-centered decisions."

"We had a backlog that made turnaround times at least 14 days; now teams can get answers within three days through democratization."

"Lighthouse reduces time spent searching for insights by having everything in one place."

"Democratization is about letting go of some research and enabling teams to learn from customers directly."

"The buddy system ensures quality by requiring study review and approval before launching."

"Continuous Discovery runs every two to three weeks with dedicated researchers tied to specific product journeys."

"Recruiting used to take 4 to 6 weeks; now, with app push notifications, we can fill interviews within an hour and a half."

"Designers want to learn how to do research because they get autonomy and faster feedback, not just waiting weeks."

"We shifted from an output mindset of how much work we do to an outcome mindset of the impact our work delivers."

Ask the Rosenbot
Jacqui Frey
Setting the Table for Dynamic Change
2019 • DesignOps Summit 2019
Gold
Nalini Kotamraju
Research After UX
2024 • Advancing Research 2024
Gold
Briana Thomas
When Design Ops Comes in H.O.T. : A Tale of a Transformed Design Org
2021 • DesignOps Summit 2021
Gold
Todd Healy
Driving Change with CX Metrics
2023 • Enterprise UX 2023
Gold
Anat Fintzi
Delivering at Scale: Making Traction with Resistant Partners
2022 • Design at Scale 2022
Gold
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Amy Bucher
Harnessing behavioral science to uncover deeper truths
2025 • Advancing Research 2025
Gold
JP Allen
Navigating the UX Tools Landscape
2021 • DesignOps Summit 2021
Gold
Benjamin Real
Showing the Value of DesignOps by Not Having a DesignOps Team
2020 • DesignOps Summit 2020
Gold
Llewyn Paine
[Demo] Deploying AI doppelgangers to de-identify user research recordings
2024 • Designing with AI 2024
Gold
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Sarah Barrett
The "How" of Enterprise Information Architecture
2023 • Enterprise UX 2023
Gold
Adam Cutler
People + Places + Practices = Outcomes
2016 • Enterprise UX 2016
Gold
Maria Skaaden
Continuous Design: One eye on the horizon and the other on the next wave
2018 • DesignOps Summit 2018
Gold
Noah Bond
Redefining truth and inclusivity: Navigating data ownership and ethical research in the age of disinformation
2025 • Advancing Research 2025
Gold
Marisa Bernstein
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
2021 • Civic Design 2021
Gold

More Videos

Edward Cupps

"Managers don’t have to go it alone; principal ICs can be key partners for coaching and strategic initiatives."

Edward Cupps

The Principal Path: Journeying from Management to Individual Contributor

June 11, 2021

Heidi Trost

"You cannot improve security outcomes until you improve the relationship between Alice and Charlie."

Heidi Trost

To Protect People, You Have to Protect Information: A Human-Centered Design Approach to Cybersecurity

January 23, 2025

Emily Danielson

"We turned all of these files in boxes into an Excel file, and then into a shared Google Doc accessible to multiple people."

Emily Danielson

“I mean, I can lift a shovel”: Design Skills in Disaster Response

June 9, 2022

Sofía Delsordo

"We wanted them to see the government not as an old machine, but as people who see themselves as users."

Sofía Delsordo Kassim Vera

Public Policy for Jalisco's Designers to Make Design Matter

December 8, 2021

Susan Simon-Daniels

"We had passed through this awkward moment. I felt I had rudely probed into this open wound."

Susan Simon-Daniels

War Stories LIVE! Susan Simon-Daniels

March 30, 2020

Kara Kane

"Having a monthly newsletter gave people one place to go instead of having to check Slack or emails all the time."

Kara Kane

Communities of Practice for Civic Design

April 7, 2022

Paz Perez

"More context is not going to make a better product; everything you put in the context competes for attention."

Paz Perez

Context Architecture for AI systems

September 11, 2026

Darian Davis

"I felt on edge and physically depleted after our interactions."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Nora Tejeda

"One design at scale advisor supports about 12 scrum teams, which is rewarding but cognitively demanding."

Nora Tejeda Giovanna Alonso

Scaling Design Capabilities at BBVA Through a Self-service Design Model

June 10, 2021