Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Atomizing Research: Trend or Trap

Gold
Monday, March 30, 2020 • Advancing Research 2020
Share the love for this talk
Atomizing Research: Trend or Trap
Speakers: Matt Duignan
Link:

Summary

There has been an explosion of interest in atomizing research, where researchers stop writing reports and instead tag individual insights in a database. The theory is that this will unlock your insights, making them findable and reusable. But does it work, and should you be doing the same? At Microsoft we tried it: Five years, 40,000 insights, 20+ research teams, and 17,000 unique users. So what have we learnt? We learnt that a structured insight library can be worth the effort. But we also learnt that atomizing insight can be taken too far. We learnt that context is critical. We learnt that short term efficiency is king, and that the required culture change is hard. And through this journey we’ve begun to discover how to blend atomized insight with your traditional research process.

Key Insights

  • Traditional research repositories often become burial grounds for insights, making it hard to find or connect reusable knowledge.

  • Shifting to atomic research focuses on individual insights as the fundamental unit rather than entire reports, enabling search, link, and remix.

  • Microsoft’s HITS system tracks dozens of thousands of insights connected across products like Windows, Xbox, and HoloLens.

  • Creating durable, reusable research insights requires overcoming strong human cognitive biases like hyperbolic discounting and in-group favoritism.

  • A culture of continuous curation and managerial priority is essential but challenging to maintain over time.

  • Immediate tactical value is key to motivating researchers to contribute to reusable knowledge rather than only producing one-off reports.

  • Allowing insights to emerge organically by observing reference patterns reduces complexity compared to rigid categorization of durable vs. raw observations.

  • Researchers and product teams benefit greatly from direct linking to specific insights and underlying evidence within their day-to-day workflows.

  • Handling conflicting insights involves encouraging researchers to collaborate and rationalize perspectives through syntheses rather than top-down arbitration.

  • The just-in-time curation approach folds creation and connection of reusable insights into immediate research tasks, reducing friction and cognitive load.

Notable Quotes

"Repository to me has a connotation of a place where stuff goes to sit and collect dust."

"What if the atomic unit of research wasn’t the reports, but it was the insight within those reports?"

"We wanted a living network of knowledge so yesterday’s insight connects to today’s evidence and tomorrow’s learning."

"Curation is super important, but also super hard."

"You have to push against 200,000 years of human evolution to get researchers to create reusable knowledge."

"Product teams want quick, grab-and-go research results, but reusable insights are more abstract and take longer to digest."

"Providing immediate tactical value is the big one for just-in-time curation."

"Standalone insights destroy the researcher’s ability to storytelling and engagement."

"Durable insights can emerge organically based on usage and referencing patterns in the system."

"The challenge is whether your organization has the energy to overcome cultural and technical barriers driving researchers back to disposable knowledge."

Ask the Rosenbot
Marina Martin
Lives on the Line: The Stakes of UX at the Scale of Government
2018 • Enterprise Experience 2018
Gold
George Zhang
UX Research Excellence Framework
2021 • Advancing Research 2021
Gold
Lisa Spitz
Building Trust Through Equitable Research Practices
2022 • Civic Design 2022
Gold
Monty Hammontree
The Future of UX Research
2020 • Advancing Research Community
Tara Tressel
Investigating qualitative depth of AI-moderated interviews
2026 • Advancing Research 2026
Gold
Dan Ward
Failure Friday #1 with Dan Ward
2025 • Rosenfeld Community
Harry Max
Priority Zero: Some Things are More Equal than Others
2016 • Enterprise UX 2016
Gold
Christian Crumlish
The Pygmalion Effect: In Which a Vibe Coding Experiment Becomes a Million Lines…
2025 • Rosenfeld Community
Dan Willis
Enterprise Storytelling Sessions
2019 • Enterprise Experience 2019
Gold
Maggie Dieringer
Cutting through the Noise
2020 • DesignOps Community
Suzan Bednarz
AccessibilityOps for All
2024 • DesignOps Summit 2020
Gold
Marc Rettig
The Urge to Migrate
2026 • Rosenfeld Community
Louis Rosenfeld
Becoming a Civic Designer: Making the Move from Private to Public Sector
2022 • Civic Design 2022
Gold
Bryce Benton
[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library
2024 • Designing with AI 2024
Gold
Joseph Meersman
Sweating the Pixel: Scaling Quality through Critique
2021 • Design at Scale 2021
Gold
Johanna Kollmann
Insights-Driven Product Strategy: Get your Research to Count
2022 • Design in Product 2022
Gold

More Videos

Bria Alexander

"It’s about us, the design ops practitioners, and what we need today to be better at our jobs."

Bria Alexander

Theme Two Intro

October 3, 2023

Ariba Jahan

"Creating space to name what we’re experiencing without guilt allowed us to unload some of that emotional weight."

Ariba Jahan

Team Resiliency Through a Pandemic

January 8, 2024

Cornelius Rachieru

"We tend to put the end user first, but we must also ask who we might be doing harm to beyond primary users."

Cornelius Rachieru

Handling Complexity: Framing a Scale of Design

June 9, 2021

Megan Clegg

"There is actually no law for private entities in the US that mandates web accessibility."

Megan Clegg Michael Haggerty-Villa Alexis Morin

Space for Everyone: Reframing Accessibility Through a Wider Lens

June 10, 2021

Saara Kamppari-Miller

"Starting a new job with no map felt lost; so I built a new map as my BYO orientation."

Saara Kamppari-Miller

Cartography for Design Communities

September 10, 2025

Kara Kane

"It’s important to reflect on our work and careers to shape what comes next."

Kara Kane

Theme One Intro

November 16, 2022

Natalia Radywyl

"Producers create a care plan for every project — they’re far more than project managers."

Natalia Radywyl

Co-Designing New Power in Australia's Public Sector

November 16, 2022

Nancy Douyon

"If you want to scale, incorporate global UX research from day one and test your assumptions broadly."

Nancy Douyon

We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex

June 15, 2018

Peter Van Dijck

"Co-creation between users and technology determines if this AI evolves to be useful or harmful."

Peter Van Dijck

Building the Rosenbot

June 4, 2024