Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Learning Velocity—The Insights Speedometer

Thursday, September 16, 2021 • Advancing Research Community
Share the love for this talk
Learning Velocity—The Insights Speedometer
Speakers: Jen Cardello and Jennifer Otto
Link:

Summary

Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.

Key Insights

  • Fidelity's UX research team faced huge scale challenges with 600+ product teams and only 35 researchers, making ubiquity impossible.

  • Focusing on research quantity, such as more studies faster, is counterproductive and considered poison; instead, learning velocity is the priority.

  • The democratization program trained over 200 designers and product partners to independently run unmoderated usability tests, cutting insight turnaround from 14 days to 3 days.

  • Quality control in democratization was ensured via a buddy system and approval gating in the testing platform to maintain high research standards.

  • Lighthouse centralized all UX research insights with strict standards on metadata and titling to reduce redundancy and make insights easily discoverable.

  • Lighthouse integration with collaboration tools like Microsoft Teams encouraged organic sharing and started building insight virality and empathy culture.

  • Continuous Discovery and Feedback (CDF) introduced a steady sprint cadence with dedicated researchers per initiative, aligned to living learning agendas prioritizing research questions.

  • CDF enabled transparency and cross-team collaboration, letting teams track when questions were posed and answered, speeding prioritization and strategic alignment.

  • Rapid recruiting innovations, including app push notifications and online scheduling, transformed a 4-6 week participant recruitment process down to hours or days.

  • Cultural acceptance was crucial; designers embraced democratization for autonomy and faster validation, while researchers accepted a shift from execution to facilitation roles.

Notable Quotes

"We cannot be everywhere. So is the goal to conduct more studies faster? And we said no, it’s not. That’s poison."

"The focus is on helping the organization learn faster to make smart, human-centered decisions."

"We had a backlog that made turnaround times at least 14 days; now teams can get answers within three days through democratization."

"Lighthouse reduces time spent searching for insights by having everything in one place."

"Democratization is about letting go of some research and enabling teams to learn from customers directly."

"The buddy system ensures quality by requiring study review and approval before launching."

"Continuous Discovery runs every two to three weeks with dedicated researchers tied to specific product journeys."

"Recruiting used to take 4 to 6 weeks; now, with app push notifications, we can fill interviews within an hour and a half."

"Designers want to learn how to do research because they get autonomy and faster feedback, not just waiting weeks."

"We shifted from an output mindset of how much work we do to an outcome mindset of the impact our work delivers."

Ask the Rosenbot
Mike Oren
Improving Democratized Research with CustomGPTs and Gems
2026 • Rosenfeld Community
Rachael Dietkus, LCSW
Leading through the long tail of trauma
2022 • Enterprise Community
Sara Conklin
Exit Interview: 20 Years of Tech, One Very Big Bet, and a Lot of Heat Pumps
2026 • Rosenfeld Community
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Civic Design 2022
Gold
Lada Gorlenko
Theme 1: Discussion
2024 • Enterprise Experience 2020
Gold
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Isaac Heyveld
Expand DesignOps Leadership as a Chief of Staff
2022 • DesignOps Summit 2022
Gold
Sahibzada Mayed
The Politics of Radical Research: A Manifesto
2023 • Advancing Research 2023
Gold
Harry Brignull
Beyond Clicks and Tricks: Why deceptive design has grown into a regulatory faultline
2026 • Rosenfeld Community
Louis Rosenfeld
Opening Remarks
2023 • Advancing Research 2023
Gold
Dan Willis
Enterprise Storytelling Sessions
2017 • Enterprise Experience 2017
Gold
Louis Rosenfeld
The Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld
2024 • Designing with AI 2024
Gold
Sandra Camacho
Creating More Bias-Proof Designs
2025 • Rosenfeld Community
Christian Crumlish
AMA with Christian Crumlish, author of Product Management for UX People
2022 • Enterprise Community
Marjorie Stainback
What Research Ops Professionals Have Learned from COVID-19
2020 • Advancing Research Community
Tricia Wang
SCALE: Discussion
2018 • Enterprise Experience 2018
Gold

More Videos

Bria Alexander

"Design ops is still defining its service offering and must articulate value both internally and to business partners - Zi."

Bria Alexander Patrizia Bertini Peter Boersma Jon Fukuda Dave Malouf Theresa Slate Changying (Z) Zheng

Charting the future of DesignOps: A community workshop

April 18, 2024

Kate Kalcevich

"Personas tend to not give you those deep insights that you would get from user research and user testing."

Kate Kalcevich

Designing inclusively with AI

June 5, 2024

Kat Vellos

"One in five people say they deal with feelings of disconnection and loneliness in the workplace."

Kat Vellos

Opener: The Other L Word

January 8, 2024

Savannah Carlin

"You want to assist people in framing the interaction and setting their expectations correctly so they know how to be successful."

Savannah Carlin

Don't botch the bot: Designing interactions for AI

June 4, 2024

Giff Constable

"Starting with a blank spreadsheet forces you to think through your system very deeply, connecting feature changes to financial impacts."

Giff Constable

Financial fluency for product leaders: AMA with Giff Constable

April 11, 2024

Lija Hogan

"Empathic data is the most accessible starting point for people who are not trained researchers."

Lija Hogan

Doing more with more: Lessons from the Front Lines of Democratization

March 9, 2022

Jorge Arango

"GPT-4 functioned as an assistant not just in retagging but also in improving the taxonomy itself."

Jorge Arango

[Demo] How to re-categorize content at scale using LLMs

June 5, 2024

Saara Kamppari-Miller

"I am one of the lucky ones. I have not lost my job this year and I get to work on inclusion and accessibility every day."

Saara Kamppari-Miller

Theme Three Intro

October 4, 2023

Ryan Matthew

"They really needed to take a serious look at their 500 plus variables and get better about their collections."

Ryan Matthew Alex Kurchev

DesignOps without Boundaries: Building More with What You Have

September 10, 2025