Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Finding the unknown in the known: Harnessing meta-analysis and literature review
Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Finding the unknown in the known: Harnessing meta-analysis and literature review
Speakers: Katie Hansen
Link:

Summary

Meta-analyses and literature reviews tap into the vast potential of existing research, uncovering powerful insights that can transform your work. These often-underused methods go beyond desk research, saving you time and money while adding depth and rigor to your findings. We’ll inspire you to embrace these tools and guide you on how to leverage them to elevate your research to new heights.

Key Insights

  • Revisiting existing research can save weeks or months by building on previously gathered insights.

  • Literature reviews provide rich thematic understanding, while meta-analyses quantitatively aggregate findings to reveal robust patterns.

  • Thumbtack's Homeowner Playbook synthesized insights from over 85 studies to create a foundational, strategic resource that cultivates empathy and aligns teams.

  • Leadership buy-in and internal communications are crucial for ensuring organizational adoption and visibility of research syntheses.

  • Meta-analysis can answer new, high-impact questions that original studies were not designed to address.

  • The Nielsen Norman Group’s search meta-analysis revealed the 'pinball pattern' where users bounce between multiple search result elements instead of scanning linearly.

  • Synthesizing research requires careful handling of selection bias, overgeneralization, variable data formats, and time/resource constraints.

  • Creating living documents that are periodically updated keeps synthesized research relevant and impactful over time.

  • Collaborative brainstorming and structured databases help organize large volumes of internal research for effective synthesis.

  • Even small efforts to revisit and synthesize research can significantly elevate team alignment and strategic decision making.

Notable Quotes

"The answers to our most pressing questions aren’t out there waiting to be discovered, but right here hidden in what we already know."

"Meta-analysis is like looking at the average Rotten Tomatoes score to get an overall sentiment from many individual reviews."

"A literature review pulls together different perspectives to paint a bigger picture, not just averages."

"Every piece of research we’ve conducted represents valuable context and insights that can still guide us today."

"The Homeowner Playbook helped align teams across product, marketing, and operations by giving everyone a shared research fact understanding."

"It doesn’t happen very often, but I’m speechless. I’m truly impressed by the clarity, structure, and impressive synthesis of the Homeowner Playbook."

"Meta-analysis reveals overarching patterns that might otherwise be hidden within isolated studies."

"Users now bounce between different elements on the page influenced by visually compelling features and keywords — what we call the pinball pattern."

"Selection bias, overgeneralization, data variability, and time constraints are common challenges to synthesis."

"Start small, revisit a past study, synthesize related findings, or take a step towards creating something like a playbook for your own organization."

Ask the Rosenbot
Christian Crumlish
Morning Insights Panel
2022 • Design in Product 2022
Gold
Tristin Oldani
Turning awareness into action with Climate UX
2025 • Climate UX Interest Group
Sarah Brooks
Theme 3 Intro
2021 • Civic Design 2021
Gold
Adrian Howard
Sturgeon’s Biases
2024 • DesignOps Summit 2024
Gold
Jemma Ahmed
Theme 1 Intro
2026 • Advancing Research 2026
Conference
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Design in Product 2023
Gold
Greg Petroff
The Compass Mission
2021 • Advancing Research 2021
Gold
Tina Weisser
When AI Agents Meet Reality. Service Design Lessons from a Pilot
2026 • Rosenfeld Community
Tiffany Cheng
Designing in a Pandemic: Integrating Speed and Rigor
2022 • Design at Scale 2022
Gold
Jeff Gothelf
Innovation Studios: the Engines of Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Robin Beers
Navigating organizational systems: Rethinking researcher’s role in driving change
2025 • Advancing Research 2025
Gold
Susan Simon-Daniels
War Stories LIVE! Susan Simon-Daniels
2020 • Advancing Research 2020
Gold
Michael Weir
Mixed Methods and Behavioural Science
2023 • Rosenfeld Community
Patrizia Bertini
The (r)evolution of designOps: It’s Time to Think (really) BIG
2025 • DesignOps Summit 2025
Gold
Saara Kamppari-Miller
Inclusive Design is DesignOps
2021 • DesignOps Summit 2021
Gold

More Videos

Christian Crumlish

"You can build your strategy into eight pages, five, three, one, half a page, then a sentence to adapt to your audience."

Christian Crumlish Wendy Johansson Rich Mironov Aditi Ruiz Adam Thomas

Afternoon Insights Panel

December 6, 2022

Michael Land

"In government, the org chart really matters – it influences who talks to whom and who gets to interface."

Michael Land

Establishing Design Operations in Government

February 18, 2021

Bria Alexander

"Please read our code of conduct. Every participant should feel safe, included, and welcome."

Bria Alexander Louis Rosenfeld

Welcome

September 8, 2022

Surya Vanka

"There are 8 billion creative humans on planet Earth, far beyond the number of trained designers."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021

Cassandra Piester

"Everyone has thoughts on what their job is, so starting with roles and responsibilities gets quick buy-in."

Cassandra Piester

Developing and Deploying Your Design Operations Strategy

September 24, 2024

Ariel Kennan

"Many governments need to buy design services to augment their internal capacities."

Ariel Kennan

Theme 2 Intro

December 9, 2021

Joshua Graves

"You need to know your limits on how far you’re willing to exert influence and your energy investment."

Joshua Graves

We Need To Talk: Navigating Conversations with Your Boss (Part 1 of 3)

April 14, 2025

Peter Van Dijck

"If you understand how engineers think about these models, you won’t be scared of concepts like synthetic data or tool use."

Peter Van Dijck

Building impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!

July 30, 2025

Bria Alexander

"Please put your questions inside the thread specific to the talk so we can keep everything organized."

Bria Alexander

Opening Remarks

November 17, 2022