Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Finding the unknown in the known: Harnessing meta-analysis and literature review

Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Finding the unknown in the known: Harnessing meta-analysis and literature review
Speakers: Katie Hansen
Link:

Summary

Meta-analyses and literature reviews tap into the vast potential of existing research, uncovering powerful insights that can transform your work. These often-underused methods go beyond desk research, saving you time and money while adding depth and rigor to your findings. We’ll inspire you to embrace these tools and guide you on how to leverage them to elevate your research to new heights.

Key Insights

  • Revisiting existing research can save weeks or months by building on previously gathered insights.

  • Literature reviews provide rich thematic understanding, while meta-analyses quantitatively aggregate findings to reveal robust patterns.

  • Thumbtack's Homeowner Playbook synthesized insights from over 85 studies to create a foundational, strategic resource that cultivates empathy and aligns teams.

  • Leadership buy-in and internal communications are crucial for ensuring organizational adoption and visibility of research syntheses.

  • Meta-analysis can answer new, high-impact questions that original studies were not designed to address.

  • The Nielsen Norman Group’s search meta-analysis revealed the 'pinball pattern' where users bounce between multiple search result elements instead of scanning linearly.

  • Synthesizing research requires careful handling of selection bias, overgeneralization, variable data formats, and time/resource constraints.

  • Creating living documents that are periodically updated keeps synthesized research relevant and impactful over time.

  • Collaborative brainstorming and structured databases help organize large volumes of internal research for effective synthesis.

  • Even small efforts to revisit and synthesize research can significantly elevate team alignment and strategic decision making.

Notable Quotes

"The answers to our most pressing questions aren’t out there waiting to be discovered, but right here hidden in what we already know."

"Meta-analysis is like looking at the average Rotten Tomatoes score to get an overall sentiment from many individual reviews."

"A literature review pulls together different perspectives to paint a bigger picture, not just averages."

"Every piece of research we’ve conducted represents valuable context and insights that can still guide us today."

"The Homeowner Playbook helped align teams across product, marketing, and operations by giving everyone a shared research fact understanding."

"It doesn’t happen very often, but I’m speechless. I’m truly impressed by the clarity, structure, and impressive synthesis of the Homeowner Playbook."

"Meta-analysis reveals overarching patterns that might otherwise be hidden within isolated studies."

"Users now bounce between different elements on the page influenced by visually compelling features and keywords — what we call the pinball pattern."

"Selection bias, overgeneralization, data variability, and time constraints are common challenges to synthesis."

"Start small, revisit a past study, synthesize related findings, or take a step towards creating something like a playbook for your own organization."

Ask the Rosenbot
Husani Oakley
Bias Towards Action: Building Teams that Build Work
2018 • Enterprise Experience 2018
Gold
Connect with the Advancing Research Community
2026 • Advancing Research 2026
Gold
Dave Gray
Group Activity: Making Sense of DesignOps
2017 • DesignOps Summit 2017
Gold
Daniela Magaña Flores
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
2022 • Advancing Research 2022
Gold
Steve Krug
Don’t Make Me Think 3.0: What Endures and What Evolves in UX
2026 • Advancing Research 2026
Gold
Carla Casariego
DesignOps in Wonderland
2019 • DesignOps Summit 2019
Gold
Cheryl Platz
Collaborative Creativity through Improv
2018 • DesignOps Summit 2018
Gold
John Calhoun
Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam
2023 • DesignOps Summit 2023
Gold
Jacqui Frey
Flow and Superfluidity for Design Orgs
2018 • DesignOps Summit 2018
Gold
Zariah Cameron
Streamlining an Inclusive Design Practice
2023 • DesignOps Summit 2023
Gold
Jessica Norris
ADHD: A DesignOps Superpower
2022 • DesignOps Summit 2022
Gold
Kyle Godbey
Non-linear service design for complex adaptive systems
2025 • Rosenfeld Community
Dave Gray
Connection, Community, and the Future of Work
2026 • Rosenfeld Community
JJ Kercher
A Roadmap for Maturing Design in the Enterprise
2018 • Enterprise Experience 2018
Gold
Steve Sanderson
Discussion
2015 • Enterprise UX 2015
Gold
Dana Bishop
2022: The Year UX Demonstrates its Business Impact
2022 • Advancing Research 2022
Gold

More Videos

Kate Kalcevich

"If you have questions, I will take questions throughout."

Kate Kalcevich

Designing inclusively with AI

June 5, 2024

Sarah Rink

"Having a recruitment team that does pre-session phone screenings was a luxury that helped a lot."

Sarah Rink

Remote User Research: Dos and Don'ts from the Virtual Field

June 11, 2020

Brendan Jarvis

"We don’t have to restrict ourselves to playing the canary in the coal mine. We can design the harm out of our products before they’ve even taken flight."

Brendan Jarvis

Framing Tomorrow by Questioning Today

June 8, 2022

Mike Brzozowski

"Design should offer tangible co-benefits like saving money or time to motivate sustainable choices."

Mike Brzozowski Laura Palotie Steve Isley Nancy Tsang

UX in everyday products: Empowering climate conscious choices

July 17, 2024

Melissa Schmidt

"It is a lot more meaningful when I can meet with batches of customers in person and see their reactions, knowing I can improve their working life."

Melissa Schmidt Adam Menter

How UX Research Hit It Big in Las Vegas

June 4, 2019

Steve Chaparro

"Design is deeply entrenched in emotional intelligence; it’s about understanding the question beneath the question."

Steve Chaparro

Bringing Into Alignment Brand, Culture and Space

August 13, 2020

Scott Stephens

"There is an emerging role of document architects who design how information is interconnected and triggers workflows in these platforms."

Scott Stephens

The Next Generation in DesignOps Toolsets

July 28, 2022

Saara Kamppari-Miller

"Accessibility ownership should never fall on just one person but be understood and shared across entire product teams."

Saara Kamppari-Miller

DesignOps for Inclusive Design and Accessibility

May 26, 2022

Ashley Sewall

"I was so desensitized to the stress and urgency that it just became my baseline for living life."

Ashley Sewall

Exit Interview #5: Designing My Life After Tech

February 19, 2026