Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Finding the unknown in the known: Harnessing meta-analysis and literature review
Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Finding the unknown in the known: Harnessing meta-analysis and literature review
Speakers: Katie Hansen
Link:

Summary

Meta-analyses and literature reviews tap into the vast potential of existing research, uncovering powerful insights that can transform your work. These often-underused methods go beyond desk research, saving you time and money while adding depth and rigor to your findings. We’ll inspire you to embrace these tools and guide you on how to leverage them to elevate your research to new heights.

Key Insights

  • Revisiting existing research can save weeks or months by building on previously gathered insights.

  • Literature reviews provide rich thematic understanding, while meta-analyses quantitatively aggregate findings to reveal robust patterns.

  • Thumbtack's Homeowner Playbook synthesized insights from over 85 studies to create a foundational, strategic resource that cultivates empathy and aligns teams.

  • Leadership buy-in and internal communications are crucial for ensuring organizational adoption and visibility of research syntheses.

  • Meta-analysis can answer new, high-impact questions that original studies were not designed to address.

  • The Nielsen Norman Group’s search meta-analysis revealed the 'pinball pattern' where users bounce between multiple search result elements instead of scanning linearly.

  • Synthesizing research requires careful handling of selection bias, overgeneralization, variable data formats, and time/resource constraints.

  • Creating living documents that are periodically updated keeps synthesized research relevant and impactful over time.

  • Collaborative brainstorming and structured databases help organize large volumes of internal research for effective synthesis.

  • Even small efforts to revisit and synthesize research can significantly elevate team alignment and strategic decision making.

Notable Quotes

"The answers to our most pressing questions aren’t out there waiting to be discovered, but right here hidden in what we already know."

"Meta-analysis is like looking at the average Rotten Tomatoes score to get an overall sentiment from many individual reviews."

"A literature review pulls together different perspectives to paint a bigger picture, not just averages."

"Every piece of research we’ve conducted represents valuable context and insights that can still guide us today."

"The Homeowner Playbook helped align teams across product, marketing, and operations by giving everyone a shared research fact understanding."

"It doesn’t happen very often, but I’m speechless. I’m truly impressed by the clarity, structure, and impressive synthesis of the Homeowner Playbook."

"Meta-analysis reveals overarching patterns that might otherwise be hidden within isolated studies."

"Users now bounce between different elements on the page influenced by visually compelling features and keywords — what we call the pinball pattern."

"Selection bias, overgeneralization, data variability, and time constraints are common challenges to synthesis."

"Start small, revisit a past study, synthesize related findings, or take a step towards creating something like a playbook for your own organization."

Ask the Rosenbot
Kevin Bethune
Reimagining Design: Unlocking Strategic Innovation
2022 • Design at Scale 2022
Gold
Benjamin Real
Maturity Models: A Core Tool for Creating a DesignOps Strategy
2021 • DesignOps Summit 2021
Gold
Shawna Hein
Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
2022 • Civic Design 2022
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold
Gonzalo Goyanes
Design ROI: Cover a Little, Get a Lot
2022 • DesignOps Summit 2022
Gold
Billy Carlson
Tips to Utilize Wireframes to Tell an Effective Product Story
2023 • Enterprise UX 2023
Gold
Emily Lessard
RFPs Without Tears: Writing Inclusive RFPS that Don't Scare Away Talent
2021 • Civic Design 2021
Gold
Adam Cutler
People + Places + Practices = Outcomes
2016 • Enterprise UX 2016
Gold
Kim Holt
A Salesforce Panel Discussion on Values-Driven DesignOps
2022 • DesignOps Summit 2022
Gold
Sydney Lawson
Anatomy of a Strong User Panel
2026 • Advancing Research 2026
Conference
Vanessa Varin
Feedback: The Other F-Word
2025 • DesignOps Summit 2025
Gold
Sha Hwang
The Lost Year
2021 • Design at Scale 2021
Gold
Louis Rosenfeld
The Bigger Picture: A Panel Discussion
2019 • DesignOps Summit 2019
Gold
Susan Simon-Daniels
War Stories LIVE! Susan Simon-Daniels
2020 • Advancing Research 2020
Gold
Jackie Velasquez-Ross
Talent Acquisition and Our Responsibility
2020 • DesignOps Community
Jose Coronado
From Zero to Hero
2022 • DesignOps Summit 2022
Gold

More Videos

Sarah Auslander

"Small, tactical projects helped us secure political will and organizational capacity needed for systemic policy change."

Sarah Auslander

Incremental Steps to Drive Radical Innovation in Policy Design

November 18, 2022

Uday Gajendar

"Enterprise UX is basically the design of cluster-fuck complexity, scale, and hairball relationships."

Uday Gajendar Lada Gorlenko Dave Malouf Louis Rosenfeld Dan Willis

10 Years of Enterprise UX: Reflecting on the community and the practice

June 18, 2025

Susan Weinschenk

"In engineering cultures, UX is sometimes seen as too vague or uncontrollable, so framing UX impact via metrics helps."

Susan Weinschenk

Evaluating the Maturity of UX in Your Organization

January 15, 2020

Sam Proulx

"Mobile interaction with gestures and touch was revolutionary for accessibility."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

September 8, 2022

Kara Kane

"The international design government community started by reaching out individually via Twitter to people in governments around the world."

Kara Kane

Communities of Practice for Civic Design

April 7, 2022

John Cutler

"Some of the most important decisions for service design happen on whiteboards among engineers, often without service design representation."

John Cutler

Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)

December 3, 2024

Erin Hoffman-John

"Changing low leverage points in a system produces fine tuning, but shifting high leverage points can cause radical disruption."

Erin Hoffman-John

This Game is Never Done: Design Leadership Techniques from the Video Game World

November 6, 2017

Tom Armitage

"Some AI companies charge for services even when their datasets are limited and can misrepresent certain populations."

Tom Armitage Carla Diana Kanene Ayo Holder

Day 2 Panel: Looking ahead: Designing with AI in 2026

June 11, 2025

Jen Briselli

"Learning is the foundational design pattern of complex systems. It's emergent, relational and contextual."

Jen Briselli

Learning Is The Engine: Designing & Adapting in a World We Can’t Predict

April 16, 2025