Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Finding the unknown in the known: Harnessing meta-analysis and literature review

Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Finding the unknown in the known: Harnessing meta-analysis and literature review
Speakers: Katie Hansen
Link:

Summary

Meta-analyses and literature reviews tap into the vast potential of existing research, uncovering powerful insights that can transform your work. These often-underused methods go beyond desk research, saving you time and money while adding depth and rigor to your findings. We’ll inspire you to embrace these tools and guide you on how to leverage them to elevate your research to new heights.

Key Insights

  • Revisiting existing research can save weeks or months by building on previously gathered insights.

  • Literature reviews provide rich thematic understanding, while meta-analyses quantitatively aggregate findings to reveal robust patterns.

  • Thumbtack's Homeowner Playbook synthesized insights from over 85 studies to create a foundational, strategic resource that cultivates empathy and aligns teams.

  • Leadership buy-in and internal communications are crucial for ensuring organizational adoption and visibility of research syntheses.

  • Meta-analysis can answer new, high-impact questions that original studies were not designed to address.

  • The Nielsen Norman Group’s search meta-analysis revealed the 'pinball pattern' where users bounce between multiple search result elements instead of scanning linearly.

  • Synthesizing research requires careful handling of selection bias, overgeneralization, variable data formats, and time/resource constraints.

  • Creating living documents that are periodically updated keeps synthesized research relevant and impactful over time.

  • Collaborative brainstorming and structured databases help organize large volumes of internal research for effective synthesis.

  • Even small efforts to revisit and synthesize research can significantly elevate team alignment and strategic decision making.

Notable Quotes

"The answers to our most pressing questions aren’t out there waiting to be discovered, but right here hidden in what we already know."

"Meta-analysis is like looking at the average Rotten Tomatoes score to get an overall sentiment from many individual reviews."

"A literature review pulls together different perspectives to paint a bigger picture, not just averages."

"Every piece of research we’ve conducted represents valuable context and insights that can still guide us today."

"The Homeowner Playbook helped align teams across product, marketing, and operations by giving everyone a shared research fact understanding."

"It doesn’t happen very often, but I’m speechless. I’m truly impressed by the clarity, structure, and impressive synthesis of the Homeowner Playbook."

"Meta-analysis reveals overarching patterns that might otherwise be hidden within isolated studies."

"Users now bounce between different elements on the page influenced by visually compelling features and keywords — what we call the pinball pattern."

"Selection bias, overgeneralization, data variability, and time constraints are common challenges to synthesis."

"Start small, revisit a past study, synthesize related findings, or take a step towards creating something like a playbook for your own organization."

Ask the Rosenbot
Tricia Wang
SCALE: Discussion
2018 • Enterprise Experience 2018
Gold
Liza Pemstein
Scaling Research Via an Ops First Model at Clever
2023 • Advancing Research 2023
Gold
Erika Kincaid
Connecting the Dots: How to Foster Collaboration and Build a Strong Design Review Culture
2022 • Design at Scale 2022
Gold
Greg Petroff
The Compass Mission
2021 • Advancing Research 2021
Gold
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Jeff Gothelf
Innovation Studios: the Engines of Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Uday Gajendar
Leading through the long tail of trauma
2022 • Advancing Research Community
Rich Mironov
How Can Product Managers and UXers Help Each Other (and Why are Product Folks so Annoying Sometimes)?
2022 • Design in Product 2022
Gold
Ben Reason
Making the system visible: The fastest path to better decisions
2025 • Advancing Service Design 2025
Gold
Dean Broadley
Not Black Enough to be White
2024 • DesignOps Summit 2020
Gold
Sofía Delsordo
Public Policy for Jalisco's Designers to Make Design Matter
2021 • Civic Design 2021
Gold
Llewyn Paine
Day 1 Using AI in UX with Impact
2025 • Designing with AI 2025
Gold
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Amahra Spence
Designing for Liberation, Rehearsing Freedom
2022 • Civic Design 2022
Gold
Bob Baxley
Theme 4: Intro
2024 • Enterprise Experience 2020
Gold
Jennifer Kanyamibwa
Creating the Blueprint: Growing and Building Design Teams
2018 • DesignOps Summit 2018
Gold

More Videos

Jon Fukuda

"Businesses are stripping down to skeleton crews and canceling anything that doesn't directly drive revenue."

Jon Fukuda

Theme One Intro

October 2, 2023

Amber Knabl

"85% of Netflix users opt for captions, showing how accessibility features benefit everyone, not just those with disabilities."

Amber Knabl

Empowering innovation: The critical role of inclusive product development in the AI era

June 4, 2024

Prabhas Pokharel

"Whenever I interview customers, they know all my tricks."

Prabhas Pokharel Mayo Nissen

Order and Chaos: New Ways of Collaborating on Synthesis and Storytelling

March 10, 2022

Bria Alexander

"Managing to outcome, not output, lets people own their way of working and leverages their best strengths."

Bria Alexander Laura Gatewood Corey Long Daniel Orbach Laine Prokay Deanna Smith

The Big Question about Resilience: A panel discussion

September 23, 2024

Kristen Honey

"The peer review process is slow and gatekeeps change, so innovating from the margins is strategic."

Kristen Honey

"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design

November 18, 2021

Jake Burghardt

"Stop Wasting Research isn’t about conducting new research; it’s about getting more juice from existing insights."

Jake Burghardt

Stop wasting research: Unlock more value from research insights

June 24, 2025

Marjorie Stainback

"In a team of two supporting 35 researchers, we planned a roadmap to focus on a few ops pillars at a time."

Marjorie Stainback Molly Fargotstein Stephanie Marsh

What Research Ops Professionals Have Learned from COVID-19

July 16, 2020

Mac Smith

"If you can follow the simple steps of preparing, aligning, and delivering, you can shift the focus and impact of your team."

Mac Smith

Measuring Up: Using Product Research for Organizational Impact

March 12, 2021

Mackenzie Guinon

"The most successful researchers I’ve worked with have traversed the most non-linear and seemingly meandering career paths possible."

Mackenzie Guinon

M.C. Escher’s UX Research Career Ladder

March 9, 2022