Rosenverse
Finding the unknown in the known: Harnessing meta-analysis and literature review

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Finding the unknown in the known: Harnessing meta-analysis and literature review

Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Finding the unknown in the known: Harnessing meta-analysis and literature review
Speakers: Katie Hansen
Link:

Summary

Meta-analyses and literature reviews tap into the vast potential of existing research, uncovering powerful insights that can transform your work. These often-underused methods go beyond desk research, saving you time and money while adding depth and rigor to your findings. We’ll inspire you to embrace these tools and guide you on how to leverage them to elevate your research to new heights.

Key Insights

  • •

    Revisiting existing research can save weeks or months by building on previously gathered insights.

  • •

    Literature reviews provide rich thematic understanding, while meta-analyses quantitatively aggregate findings to reveal robust patterns.

  • •

    Thumbtack's Homeowner Playbook synthesized insights from over 85 studies to create a foundational, strategic resource that cultivates empathy and aligns teams.

  • •

    Leadership buy-in and internal communications are crucial for ensuring organizational adoption and visibility of research syntheses.

  • •

    Meta-analysis can answer new, high-impact questions that original studies were not designed to address.

  • •

    The Nielsen Norman Group’s search meta-analysis revealed the 'pinball pattern' where users bounce between multiple search result elements instead of scanning linearly.

  • •

    Synthesizing research requires careful handling of selection bias, overgeneralization, variable data formats, and time/resource constraints.

  • •

    Creating living documents that are periodically updated keeps synthesized research relevant and impactful over time.

  • •

    Collaborative brainstorming and structured databases help organize large volumes of internal research for effective synthesis.

  • •

    Even small efforts to revisit and synthesize research can significantly elevate team alignment and strategic decision making.

Notable Quotes

"The answers to our most pressing questions aren’t out there waiting to be discovered, but right here hidden in what we already know."

"Meta-analysis is like looking at the average Rotten Tomatoes score to get an overall sentiment from many individual reviews."

"A literature review pulls together different perspectives to paint a bigger picture, not just averages."

"Every piece of research we’ve conducted represents valuable context and insights that can still guide us today."

"The Homeowner Playbook helped align teams across product, marketing, and operations by giving everyone a shared research fact understanding."

"It doesn’t happen very often, but I’m speechless. I’m truly impressed by the clarity, structure, and impressive synthesis of the Homeowner Playbook."

"Meta-analysis reveals overarching patterns that might otherwise be hidden within isolated studies."

"Users now bounce between different elements on the page influenced by visually compelling features and keywords — what we call the pinball pattern."

"Selection bias, overgeneralization, data variability, and time constraints are common challenges to synthesis."

"Start small, revisit a past study, synthesize related findings, or take a step towards creating something like a playbook for your own organization."

Ask the Rosenbot
Bryce Benton
[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library
2024 • Designing with AI 2024
Gold
Angy Peterson
More Than Technology: Personalized Public Sector Experiences
2021 • Civic Design 2021
Gold
Caroline Jarrett
Garbage in, garbage out? Measuring error rates to get ready for AI
2026 • Rosenfeld Community
Jorge Arango
Exploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)
2024 • Rosenfeld Community
Benjamin Real
Showing the Value of DesignOps by Not Having a DesignOps Team
2020 • DesignOps Summit 2020
Gold
Sarah Barrett
The "How" of Enterprise Information Architecture
2023 • Enterprise UX 2023
Gold
Dave Malouf
Panel: Design Systems and Documentation
2017 • DesignOps Summit 2017
Gold
Alana Washington
(Remote) Service Design: A Transformation Case Study
2022 • Design at Scale 2022
Gold
Peter Merholz
The 2025 State of UX/Design Organizational Health
2025 • Rosenfeld Community
Jacqui Frey
Flow and Superfluidity for Design Orgs
2018 • DesignOps Summit 2018
Gold
Adel Du Toit
Get Your CFO To Say: 'Our Strategic Goal is User Obsession'
2022 • Design at Scale 2022
Gold
Lori Muszynski
Keeping Design Weird
2023 • DesignOps Summit 2023
Gold
Mackenzie Guinon
M.C. Escher’s UX Research Career Ladder
2022 • Advancing Research 2022
Gold
Adam Cutler
People + Places + Practices = Outcomes
2016 • Enterprise UX 2016
Gold
Ellen Chisa
The Values of Design
2023 • Design in Product 2023
Gold
Shawna Hein
Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
2022 • Civic Design 2022
Gold

More Videos

Marc Majers

"Interruptions reveal things like auto-save that you never thought about before."

Marc Majers Tony Turner

Interrupted UX - Add A Dose of Reality To Usability Testing

March 11, 2022

Megan Blocker

"We need to transform our role as connectors between people, disciplines, and ideas that together make our work richer and more impactful."

Megan Blocker

Theme 2 Intro

March 12, 2025

Anna Poznyakov

"A research findings and recommendations tracker helps us keep findings alive and prioritized throughout the Agile delivery process."

Anna Poznyakov Richa Prajapati

Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact

March 12, 2021

David Conrad

"The Power BI team succeeds with data because everyone on the team is obsessed with understanding customer behavior."

David Conrad

The Feeling of Data

September 14, 2023

Maria Rosala

"We have been good with not having fake or hallucinated answers so far, and retaining context is key."

Maria Rosala Shivanjali M.

Research Repositories

March 12, 2026

Tim Frick

"Becoming a B Corp really made us redesign everything about the business."

Tim Frick

The journey of building a sustainable design practice

April 23, 2025

Jack Behar

"Designers and developers work from the same source of truth, promoting pixel-perfect parity and consistent user experience."

Jack Behar

How to Build Prototypes that Behave like an End-Product

December 6, 2022

Cheryl Platz

"Playing silly improv games reconnects you with your kindergarten self and builds hidden listening muscles."

Cheryl Platz

Merging Improv with Design

March 7, 2019

Eduardo Ortiz

"Researchers are becoming stewards of organizational wisdom, not just collectors of insight."

Eduardo Ortiz

Theme 3 Intro

March 13, 2025