Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Atomizing Research: Trend or Trap
Gold
Monday, March 30, 2020 • Advancing Research 2020
Share the love for this talk
Atomizing Research: Trend or Trap
Speakers: Matt Duignan
Link:

Summary

There has been an explosion of interest in atomizing research, where researchers stop writing reports and instead tag individual insights in a database. The theory is that this will unlock your insights, making them findable and reusable. But does it work, and should you be doing the same? At Microsoft we tried it: Five years, 40,000 insights, 20+ research teams, and 17,000 unique users. So what have we learnt? We learnt that a structured insight library can be worth the effort. But we also learnt that atomizing insight can be taken too far. We learnt that context is critical. We learnt that short term efficiency is king, and that the required culture change is hard. And through this journey we’ve begun to discover how to blend atomized insight with your traditional research process.

Key Insights

  • Traditional research repositories often become burial grounds for insights, making it hard to find or connect reusable knowledge.

  • Shifting to atomic research focuses on individual insights as the fundamental unit rather than entire reports, enabling search, link, and remix.

  • Microsoft’s HITS system tracks dozens of thousands of insights connected across products like Windows, Xbox, and HoloLens.

  • Creating durable, reusable research insights requires overcoming strong human cognitive biases like hyperbolic discounting and in-group favoritism.

  • A culture of continuous curation and managerial priority is essential but challenging to maintain over time.

  • Immediate tactical value is key to motivating researchers to contribute to reusable knowledge rather than only producing one-off reports.

  • Allowing insights to emerge organically by observing reference patterns reduces complexity compared to rigid categorization of durable vs. raw observations.

  • Researchers and product teams benefit greatly from direct linking to specific insights and underlying evidence within their day-to-day workflows.

  • Handling conflicting insights involves encouraging researchers to collaborate and rationalize perspectives through syntheses rather than top-down arbitration.

  • The just-in-time curation approach folds creation and connection of reusable insights into immediate research tasks, reducing friction and cognitive load.

Notable Quotes

"Repository to me has a connotation of a place where stuff goes to sit and collect dust."

"What if the atomic unit of research wasn’t the reports, but it was the insight within those reports?"

"We wanted a living network of knowledge so yesterday’s insight connects to today’s evidence and tomorrow’s learning."

"Curation is super important, but also super hard."

"You have to push against 200,000 years of human evolution to get researchers to create reusable knowledge."

"Product teams want quick, grab-and-go research results, but reusable insights are more abstract and take longer to digest."

"Providing immediate tactical value is the big one for just-in-time curation."

"Standalone insights destroy the researcher’s ability to storytelling and engagement."

"Durable insights can emerge organically based on usage and referencing patterns in the system."

"The challenge is whether your organization has the energy to overcome cultural and technical barriers driving researchers back to disposable knowledge."

Ask the Rosenbot
Corey Long
Hiring in DesignOps: A Critical Study on How to Hire and Get Hired
2024 • DesignOps Summit 2024
Gold
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Kaaren Hanson
Stop Talking, Start Doing
2017 • Enterprise Experience 2017
Gold
Sara Logel
Your Colleagues are Your Users Too
2023 • Advancing Research 2023
Gold
Wyatt Hayman
Global Research Panels
2020 • DesignOps Community
Louis Rosenfeld
Founder’s Welcome
2022 • Design in Product 2022
Gold
Dianne Que
Real Talk: Proving Value through a Scrappy Playbook
2019 • DesignOps Summit 2019
Gold
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2019 • Enterprise Experience 2019
Gold
Denise Jacobs
Interactive Keynote: Social Change by Design
2024 • Enterprise Experience 2020
Gold
Daniel J. Rosenberg
Digital Medicine Design
2019 • Enterprise Community
Joseph Meersman
Sweating the Pixel: Scaling Quality through Critique
2021 • Design at Scale 2021
Gold
Sarah Brooks
Theme Three Intro
2022 • Civic Design 2022
Gold
Savannah Carlin
Don't botch the bot: Designing interactions for AI
2024 • Designing with AI 2024
Gold
Cara Maritz
The Art of Extrapolation
2023 • Advancing Research 2023
Gold
Bria Alexander
OKRs—Helpful or Harmful?
2022 • DesignOps Community
Caitlyn Hampton
Compass 101: Growing Your Career In A Startup World
2021 • Design at Scale 2021
Gold

More Videos

Sam Proulx

"When you design for the edges, you make things better, more fluid, more customizable for everyone."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023

Ignacio Martinez

"The system encourages growth not just in craft but also in client engagement and team collaboration."

Ignacio Martinez

Fair and Effective Designer Evaluation

September 25, 2024

Sarah Kinkade

"Embedding designers gave them deep expertise but siloed goals prevented consistent cross-product experiences."

Sarah Kinkade Mariana Ortiz-Reyes

Design Management Models in the Face of Transformation

June 8, 2022

Daniel Gloyd

"Belonging means understanding the shape, size, and cause of your community and your unique purpose in it."

Daniel Gloyd

Warming the User Experience: Lessons from America's first and most radical human-centered designers

May 9, 2024

Patrick Boehler

"Traditional metrics create a dangerous illusion where we optimize for what we can measure, not what people actually need."

Patrick Boehler

Fishing for Real Needs: Reimagining Journalism Needs with AI

June 10, 2025

Andy Barraclough

"Providing stakeholders with real user voices alongside insights is key to internalizing and acting on research."

Andy Barraclough Betsy Nelson

From Costly Complexity to Efficient Insights: Why UX Teams Are Switching To Voxpopme

September 23, 2024

Alexandra Schmidt

"The future of our technology cannot and should not rest solely on the ethics of individual designers."

Alexandra Schmidt

Why Ethics Can't Save Tech

November 18, 2022

Louis Rosenfeld

"A lot of DevOps is about empathy — doing our piece but thinking about the larger connection."

Louis Rosenfeld

Discussion: What Operations can teach DesignOps

November 6, 2017

Mitchell Bernstein

"Discomfort and growth cannot coexist. You have to embrace discomfort to push innovation forward."

Mitchell Bernstein

Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape

September 29, 2021