Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Learning Velocity—The Insights Speedometer

Thursday, September 16, 2021 • Advancing Research Community
Share the love for this talk
Learning Velocity—The Insights Speedometer
Speakers: Jen Cardello and Jennifer Otto
Link:

Summary

Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.

Key Insights

  • Fidelity's UX research team faced huge scale challenges with 600+ product teams and only 35 researchers, making ubiquity impossible.

  • Focusing on research quantity, such as more studies faster, is counterproductive and considered poison; instead, learning velocity is the priority.

  • The democratization program trained over 200 designers and product partners to independently run unmoderated usability tests, cutting insight turnaround from 14 days to 3 days.

  • Quality control in democratization was ensured via a buddy system and approval gating in the testing platform to maintain high research standards.

  • Lighthouse centralized all UX research insights with strict standards on metadata and titling to reduce redundancy and make insights easily discoverable.

  • Lighthouse integration with collaboration tools like Microsoft Teams encouraged organic sharing and started building insight virality and empathy culture.

  • Continuous Discovery and Feedback (CDF) introduced a steady sprint cadence with dedicated researchers per initiative, aligned to living learning agendas prioritizing research questions.

  • CDF enabled transparency and cross-team collaboration, letting teams track when questions were posed and answered, speeding prioritization and strategic alignment.

  • Rapid recruiting innovations, including app push notifications and online scheduling, transformed a 4-6 week participant recruitment process down to hours or days.

  • Cultural acceptance was crucial; designers embraced democratization for autonomy and faster validation, while researchers accepted a shift from execution to facilitation roles.

Notable Quotes

"We cannot be everywhere. So is the goal to conduct more studies faster? And we said no, it’s not. That’s poison."

"The focus is on helping the organization learn faster to make smart, human-centered decisions."

"We had a backlog that made turnaround times at least 14 days; now teams can get answers within three days through democratization."

"Lighthouse reduces time spent searching for insights by having everything in one place."

"Democratization is about letting go of some research and enabling teams to learn from customers directly."

"The buddy system ensures quality by requiring study review and approval before launching."

"Continuous Discovery runs every two to three weeks with dedicated researchers tied to specific product journeys."

"Recruiting used to take 4 to 6 weeks; now, with app push notifications, we can fill interviews within an hour and a half."

"Designers want to learn how to do research because they get autonomy and faster feedback, not just waiting weeks."

"We shifted from an output mindset of how much work we do to an outcome mindset of the impact our work delivers."

Ask the Rosenbot
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka
2021 • Civic Design Community
Libby Maurer
Treating Diversity & Inclusion in Hiring as a Design Problem
2019 • Enterprise Community
Liz Ebengo
The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward
2024 • Advancing Service Design 2024
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • DesignOps Summit 2023
Gold
Sara Conklin
Exit Interview: 20 Years of Tech, One Very Big Bet, and a Lot of Heat Pumps
2026 • Rosenfeld Community
Sheryl Cababa
Integrating Systems Thinking Into Your Practice as a Designer
2025 • Rosenfeld Community
Craig Villamor
Design Systems for Ethical Design
2023 • Enterprise Community
Veevi Rosenstein
Building for Scale: Creating the Zendesk UX Research Practice
2024 • Enterprise Experience 2020
Gold
Jen Briselli
Learning Is The Engine: Designing & Adapting in a World We Can’t Predict
2025 • Rosenfeld Community
Kristin Skinner
8 Types of Measures in Design Operations
2020 • DesignOps Community
Shivanjali M.
From Fragmented to Fluent: The Linguistic Approach to Research Knowledge
2026 • Rosenfeld Community
Louis Rosenfeld
Coffee with Lou: Should You Write a (UX) Book?
2024 • Rosenfeld Community
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Design at Scale 2022
Gold
Mike Davidson
Fireside Chat
2022 • Advancing Research 2022
Gold
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Joseph Williams
Unlocking impact and influence through inclusive hiring in research
2021 • Advancing Research Community

More Videos

Peter Van Dijck

"If you build for the next model, even if it can hardly do something now, it will probably do it well in the future."

Peter Van Dijck

Hands on AI #3: Claude Code for UX people

October 22, 2025

Johnny Michaelsen

"You have to be 80% impactful and 20% helpful — that’s the balance we try to maintain."

Johnny Michaelsen

Measure Behaviors, Not Results

April 23, 2026

Boon Yew Chew

"Using systems tools is only about 5% of my day-to-day work; I handpick them to meaningfully engage stakeholders."

Boon Yew Chew

Making Sense of Systems—and Using Systems to Make Sense of the Enterprise

June 6, 2023

Jim Kalbach

"Design sprints are popular because they give us a format; we don’t have to improvise how we’re collaborating."

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

June 4, 2019

Nick Cochran

"Treat every conversation as an opportunity to make connections and learn meaningfully."

Nick Cochran

Growing in Enterprise Design through Making Connections

June 3, 2019

Anne Mamaghani

"It’s important to create a sincere environment where everyone feels they can equally participate, regardless of title or skill level."

Anne Mamaghani

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right

March 28, 2023

Sarah Flamion

"If you dive too deep into the subsystems or the bits right away, then your understanding of the whole is going to be lacking."

Sarah Flamion

Complex Problem? Add Clarity by Combining Research and Systems Thinking

March 31, 2020

Jemma Ahmed

"Vasilio Sampalis’s program at LEGO is so interesting and successful that it has attracted the attention of Gartner."

Jemma Ahmed

Theme 2 Intro

January 8, 2024

Brendan Jarvis

"Some things are up to us and some things are not. How we choose to respond is always within our control."

Brendan Jarvis

It was the Best of Times. It was the Worst of Times.

September 25, 2024