Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Learning Velocity—The Insights Speedometer
Summary
Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.
Key Insights
-
•
Fidelity's UX research team faced huge scale challenges with 600+ product teams and only 35 researchers, making ubiquity impossible.
-
•
Focusing on research quantity, such as more studies faster, is counterproductive and considered poison; instead, learning velocity is the priority.
-
•
The democratization program trained over 200 designers and product partners to independently run unmoderated usability tests, cutting insight turnaround from 14 days to 3 days.
-
•
Quality control in democratization was ensured via a buddy system and approval gating in the testing platform to maintain high research standards.
-
•
Lighthouse centralized all UX research insights with strict standards on metadata and titling to reduce redundancy and make insights easily discoverable.
-
•
Lighthouse integration with collaboration tools like Microsoft Teams encouraged organic sharing and started building insight virality and empathy culture.
-
•
Continuous Discovery and Feedback (CDF) introduced a steady sprint cadence with dedicated researchers per initiative, aligned to living learning agendas prioritizing research questions.
-
•
CDF enabled transparency and cross-team collaboration, letting teams track when questions were posed and answered, speeding prioritization and strategic alignment.
-
•
Rapid recruiting innovations, including app push notifications and online scheduling, transformed a 4-6 week participant recruitment process down to hours or days.
-
•
Cultural acceptance was crucial; designers embraced democratization for autonomy and faster validation, while researchers accepted a shift from execution to facilitation roles.
Notable Quotes
"We cannot be everywhere. So is the goal to conduct more studies faster? And we said no, it’s not. That’s poison."
"The focus is on helping the organization learn faster to make smart, human-centered decisions."
"We had a backlog that made turnaround times at least 14 days; now teams can get answers within three days through democratization."
"Lighthouse reduces time spent searching for insights by having everything in one place."
"Democratization is about letting go of some research and enabling teams to learn from customers directly."
"The buddy system ensures quality by requiring study review and approval before launching."
"Continuous Discovery runs every two to three weeks with dedicated researchers tied to specific product journeys."
"Recruiting used to take 4 to 6 weeks; now, with app push notifications, we can fill interviews within an hour and a half."
"Designers want to learn how to do research because they get autonomy and faster feedback, not just waiting weeks."
"We shifted from an output mindset of how much work we do to an outcome mindset of the impact our work delivers."
Or choose a question:
More Videos
"There is overlap between design and research when it comes to different types of research; it’s not a strict divide."
Prayag NarulaHow to Empower Your Designers to Do Good Research – And Why You Want To
June 10, 2022
"You’re all mutants, straddling engineering and design schools and feeling like the island of misfit toys."
John MaedaMaking Sense of Enterprise UX
June 9, 2016
"Our Jira integration will be two-way so you can link design activities to epics, user stories, or tasks."
Aurobinda Pradhan Shashank DeshpandeIntroduction to Collaborative DesignOps using Cubyts
September 9, 2022
"The only way to do research wrong is to not do it at all."
Benjamin Wiedmaier Annie MayfieldRedefining Toolkits: Unbundling to Create a Perfect Match
March 11, 2025
"I would let my teams have those hard experiences instead of holding the umbrella because resilience comes from facing challenges directly."
Wendy JohanssonBe a Product Boss!
December 6, 2022
"If you want to invite a friend or colleague, the sponsor sessions are free and awesome to attend."
Bria AlexanderDay 3 Welcome
September 25, 2024
"Too many teams think delivering software means success, but actual success is user achievement with the product."
Jack MoffettUX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
September 22, 2022
"Meta-analysis reveals overarching patterns that might otherwise be hidden within isolated studies."
Katie HansenFinding the unknown in the known: Harnessing meta-analysis and literature review
March 12, 2025
"Power hoarding, paternalism, perfectionism—these uphold white supremacy culture in design."
Jennifer StricklandAdopting a "Design By" Method
December 9, 2021
