Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Finding the unknown in the known: Harnessing meta-analysis and literature review
Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Finding the unknown in the known: Harnessing meta-analysis and literature review
Speakers: Katie Hansen
Link:

Summary

Meta-analyses and literature reviews tap into the vast potential of existing research, uncovering powerful insights that can transform your work. These often-underused methods go beyond desk research, saving you time and money while adding depth and rigor to your findings. We’ll inspire you to embrace these tools and guide you on how to leverage them to elevate your research to new heights.

Key Insights

  • Revisiting existing research can save weeks or months by building on previously gathered insights.

  • Literature reviews provide rich thematic understanding, while meta-analyses quantitatively aggregate findings to reveal robust patterns.

  • Thumbtack's Homeowner Playbook synthesized insights from over 85 studies to create a foundational, strategic resource that cultivates empathy and aligns teams.

  • Leadership buy-in and internal communications are crucial for ensuring organizational adoption and visibility of research syntheses.

  • Meta-analysis can answer new, high-impact questions that original studies were not designed to address.

  • The Nielsen Norman Group’s search meta-analysis revealed the 'pinball pattern' where users bounce between multiple search result elements instead of scanning linearly.

  • Synthesizing research requires careful handling of selection bias, overgeneralization, variable data formats, and time/resource constraints.

  • Creating living documents that are periodically updated keeps synthesized research relevant and impactful over time.

  • Collaborative brainstorming and structured databases help organize large volumes of internal research for effective synthesis.

  • Even small efforts to revisit and synthesize research can significantly elevate team alignment and strategic decision making.

Notable Quotes

"The answers to our most pressing questions aren’t out there waiting to be discovered, but right here hidden in what we already know."

"Meta-analysis is like looking at the average Rotten Tomatoes score to get an overall sentiment from many individual reviews."

"A literature review pulls together different perspectives to paint a bigger picture, not just averages."

"Every piece of research we’ve conducted represents valuable context and insights that can still guide us today."

"The Homeowner Playbook helped align teams across product, marketing, and operations by giving everyone a shared research fact understanding."

"It doesn’t happen very often, but I’m speechless. I’m truly impressed by the clarity, structure, and impressive synthesis of the Homeowner Playbook."

"Meta-analysis reveals overarching patterns that might otherwise be hidden within isolated studies."

"Users now bounce between different elements on the page influenced by visually compelling features and keywords — what we call the pinball pattern."

"Selection bias, overgeneralization, data variability, and time constraints are common challenges to synthesis."

"Start small, revisit a past study, synthesize related findings, or take a step towards creating something like a playbook for your own organization."

Ask the Rosenbot
Leisa Reichelt
Opening Keynote: Operating in Context
2018 • DesignOps Summit 2018
Gold
Kavana Ramesh
Meaningful inclusion: Practicing accessibility research with confidence
2024 • DesignOps Summit 2024
Gold
Kevin M. Hoffman
Theme 2: Enterprise Team Journey
2019 • Enterprise Experience 2019
Gold
Chris Geison
What is Research Strategy?
2021 • Advancing Research 2021
Gold
Louis Rosenfeld
How AI will Change DesignOps Tooling
2023 • DesignOps Summit 2023
Gold
Marjorie Stainback
Transforming Strategic Research Capacity through Democratization
2019 • DesignOps Summit 2019
Gold
Rich Mironov
How Can Product Managers and UXers Help Each Other (and Why are Product Folks so Annoying Sometimes)?
2022 • Design in Product 2022
Gold
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Tom Armitage
Day 2 Panel: Looking ahead: Designing with AI in 2026
2025 • Designing with AI 2025
Gold
Dan Willis
Enterprise Storytelling Sessions
2017 • Enterprise Experience 2017
Gold
Uday Gajendar
The Wicked Craft of Enterprise UX
2015 • Enterprise UX 2015
Gold
Edward Cupps
The Principal Path: Journeying from Management to Individual Contributor
2021 • Design at Scale 2021
Gold
Louis Rosenfeld
GenAI for UXers: A Rosenbot Demo and Discussion
2025 • Rosenfeld Community
Rebecca Buck
Mission: Keep Talent in Research Roles!
2021 • Advancing Research 2021
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Sean Baker
Weaving Knowledge Management into the Fabric of Our Design Practice
2025 • DesignOps Summit 2025
Conference

More Videos

Gabrielle Verderber

"Our folks are not looking for information about what are wireframes. They want information specific to your organization."

Gabrielle Verderber

Documentation Your Team Will Actually Use

October 3, 2023

Jennifer Kanyamibwa

"Transparency is building respect for what your teammates do."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Saara Kamppari-Miller

"We use storytelling to turn accessibility from just compliance into a business differentiator that executives care about."

Saara Kamppari-Miller Nicole Bergstrom Shashi Jain

Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”

November 13, 2024

Samuel Proulx

"The average user doesn’t exist."

Samuel Proulx

Designing beyond caricatures: Embracing real, diverse user needs

December 4, 2024

Catherine Dubut

"Being able to see faces and first names of people we're learning from makes those users tangible to the team."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Sam Ladner

"Zuboff called it informating technology—technology that serves users by providing insight, not just automating tasks."

Sam Ladner

Data Exhaust and Personal Data: Learning from Consumer Products to Enhance Enterprise UX

June 8, 2016

Sam Proulx

"Aim to work with at least one person on each platform your product supports, because assistive tech varies."

Sam Proulx

Prototype Reviews, People With Disabilities, and You

December 8, 2021

Jemma Ahmed

"The current decline in response and participant engagement rates is a genuine crisis that threatens research data quality."

Jemma Ahmed Megan Blocker Eduardo Ortiz

Redefining the research toolkit: Expanding methodologies for a changing world

March 12, 2025

Kevin Bethune

"The dominant frame became the personal narrative to contain the perspectives I wanted to serve up."

Kevin Bethune

Reimagining Design: Unlocking Strategic Innovation

June 8, 2022