Rosenverse
Finding the unknown in the known: Harnessing meta-analysis and literature review

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Finding the unknown in the known: Harnessing meta-analysis and literature review

Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Finding the unknown in the known: Harnessing meta-analysis and literature review
Speakers: Katie Hansen
Link:

Summary

Meta-analyses and literature reviews tap into the vast potential of existing research, uncovering powerful insights that can transform your work. These often-underused methods go beyond desk research, saving you time and money while adding depth and rigor to your findings. We’ll inspire you to embrace these tools and guide you on how to leverage them to elevate your research to new heights.

Key Insights

  • •

    Revisiting existing research can save weeks or months by building on previously gathered insights.

  • •

    Literature reviews provide rich thematic understanding, while meta-analyses quantitatively aggregate findings to reveal robust patterns.

  • •

    Thumbtack's Homeowner Playbook synthesized insights from over 85 studies to create a foundational, strategic resource that cultivates empathy and aligns teams.

  • •

    Leadership buy-in and internal communications are crucial for ensuring organizational adoption and visibility of research syntheses.

  • •

    Meta-analysis can answer new, high-impact questions that original studies were not designed to address.

  • •

    The Nielsen Norman Group’s search meta-analysis revealed the 'pinball pattern' where users bounce between multiple search result elements instead of scanning linearly.

  • •

    Synthesizing research requires careful handling of selection bias, overgeneralization, variable data formats, and time/resource constraints.

  • •

    Creating living documents that are periodically updated keeps synthesized research relevant and impactful over time.

  • •

    Collaborative brainstorming and structured databases help organize large volumes of internal research for effective synthesis.

  • •

    Even small efforts to revisit and synthesize research can significantly elevate team alignment and strategic decision making.

Notable Quotes

"The answers to our most pressing questions aren’t out there waiting to be discovered, but right here hidden in what we already know."

"Meta-analysis is like looking at the average Rotten Tomatoes score to get an overall sentiment from many individual reviews."

"A literature review pulls together different perspectives to paint a bigger picture, not just averages."

"Every piece of research we’ve conducted represents valuable context and insights that can still guide us today."

"The Homeowner Playbook helped align teams across product, marketing, and operations by giving everyone a shared research fact understanding."

"It doesn’t happen very often, but I’m speechless. I’m truly impressed by the clarity, structure, and impressive synthesis of the Homeowner Playbook."

"Meta-analysis reveals overarching patterns that might otherwise be hidden within isolated studies."

"Users now bounce between different elements on the page influenced by visually compelling features and keywords — what we call the pinball pattern."

"Selection bias, overgeneralization, data variability, and time constraints are common challenges to synthesis."

"Start small, revisit a past study, synthesize related findings, or take a step towards creating something like a playbook for your own organization."

Ask the Rosenbot
Vasileios Xanthopoulos
A Top-Down and Bottom-Up Approach to User-Centric Maturity at Scale
2024 • Enterprise Experience 2020
Gold
Sarah Barrett
AI in Real Life: Using LLMs to Turbocharge Microsoft Learn
2025 • Rosenfeld Community
Sarah Rink
Remote User Research: Dos and Don'ts from the Virtual Field
2020 • Advancing Research Community
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 2: Evals are your moat
2025 • Rosenfeld Community
Audrey Crane
Shadow Design–Where Else is Design Happening in Your Organization?
2023 • Enterprise Community
Max Gadney
Assessing UX jobs for impact in climate
2024 • Climate UX Interest Group
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group
Corey Nelson
Layoffs
2022 • Advancing Research Community
Bria Alexander
Reflect and Chart Forward
2021 • Civic Design 2021
Gold
Erin Weigel
Testing and Experimentation Tools
2026 • Advancing Research 2026
Gold
Sarah Gallimore
Inspire Progress with Artifacts from the Future
2022 • Civic Design 2022
Gold
Andy Polaine
What is the role of service design in product-led organizations?
2024 • Advancing Service Design 2024
Gold
Feyikemi Akinwolemiwa
Uninvited, Not Unwelcome: What Researchers Bring When Nobody Asked
2026 • Rosenfeld Community
Kristin Sundermeyer
Design Ops Metrics
2021 • DesignOps Summit 2021
Gold
Mansi Gupta
Women-Centric Research: What, Why, How
2023 • Advancing Research 2023
Gold
Louis Rosenfeld
You’ve got Gold! A Rosenverse demo with Lou Rosenfeld
2026 • Designing with AI 2026
Gold

More Videos

Carla Casariego

"We really had to go into it with an adaptable mindset and know when to drink the potion or eat the cake to grow or shrink."

Carla Casariego Sarah Spencer

DesignOps in Wonderland

October 24, 2019

Christian Crumlish

"If you want to improve the product team’s understanding, frame UX value in terms of their language and goals, not just UX jargon."

Christian Crumlish

AMA with Christian Crumlish, author of Product Management for UX People

March 24, 2022

Samuel Proulx

"41 percent of non-Western names are autocorrected into something else."

Samuel Proulx

Designing for Disability, Innovating for Everyone

March 11, 2025

Kate Towsey

"Culture often makes the biggest difference in how research ops works across industries."

Kate Towsey

Ask Me Anything (AMA) with Kate Towsey

April 2, 2025

Sam Proulx

"Most screen reader users prefer robotic voices so they can speed up the speech and read much faster than typical people."

Sam Proulx

SUS: A System Unusable for Twenty Percent of the Population

September 29, 2021

Jim Kalbach

"There are no mistakes in jazz, just missed opportunities."

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

November 6, 2017

Jorge Arango

"Some of the older content has discoverability problems, which is typical with blogs."

Jorge Arango

[Demo] How to re-categorize content at scale using LLMs

June 5, 2024

Erin Weigel

"I’m actually a really big failure — nine out of ten tests fail with no positive measurable impact."

Erin Weigel

UX Lessons from running more than 1,200 A/B Tests

July 10, 2024

Indi Young

"Casting diverse characters who represent thinking styles breaks down demographic stereotypes."

Indi Young

Thinking styles: Mend hidden cracks in your market

January 8, 2025

Latest Books All books