Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Actions and Reflections: Bridging the Skills Gap among Researchers

Gold
Wednesday, March 9, 2022 • Advancing Research 2022
Share the love for this talk
Actions and Reflections: Bridging the Skills Gap among Researchers
Speakers: Yoel Sumitro
Link:

Summary

We often hire researchers from a wide range of backgrounds. Most of the time, we need to hire fresh grads, interns, or market research experts. For these individuals with little practical experience in product/UX research and a non-research education background, we must bridge a skill gap. Yoel will talk about his experiments with a variety of ways for boosting the skills of his researchers. He'll talk about the framework he's built, as well as the advantages and disadvantages of each learning project he's tried.

Key Insights

  • Research teams with limited experience often overemphasize scientific rigor, hindering learning compared to design teams.

  • Designers use a more flexible notion of rigor based on intuition, feelings, and real-time collaboration.

  • Stolterman’s concept of design rigor is better suited to the complexity of design research than strict scientific rigor.

  • Schön’s knowing-in-action highlights intuition and reflection as core to developing professional skill and rigor.

  • Reflection-in-action is a five-step process helping practitioners improve their intuition through surprise and experimentation.

  • Dewey emphasizes learning by doing and demonstrating, not just verbal instruction, as essential for effective skill transfer.

  • Yohael’s Three Rs framework (Recount, Relate, Reframe) structures reflection on intuition in research practice.

  • Pair research and 1:1 sessions incorporating demonstration and imitation improve learning and confidence in research teams.

  • The perceived discrepancy between research and design team performance was due more to learning practices than stakeholder bias.

  • Inclusive learning frameworks can reduce impostor syndrome and expand access to design research beyond traditional academic pedigrees.

Notable Quotes

"Researchers were obsessed with scientific rigor while designers used balance, feelings, or intuition as their rigor."

"Design research faces design complexity, which deals with the specific, intentional, and the non-existing."

"Knowing in action is the intuition practiced by competent designers, a core of artistry."

"Reflection in action involves noticing surprise, questioning assumptions, experimenting, and reflecting on the move."

"Students cannot be taught what they need to know; they can only be coached to absorb it through demonstration."

"My research team focused too much on scientific rigor, while design teams improved intuition with reflection and demonstration."

"Designers adhere to standards not scientific ones, but design rigor tailored to dealing with complexity."

"Our learning framework does not prescribe but supports reflection in action and demonstration or action."

"The wrong learning pedagogy might be fueling impostor syndrome among design researchers."

"We should open our profession to fresh graduates and those without traditional design research backgrounds."

Ask the Rosenbot
Peter Van Dijck
Hands-on AI #1: Let’s write your first AI eval
2025 • Rosenfeld Community
Taylor Klassman
Shaping the Next Era of UX Research: Collaborative Forum
2025 • Advancing Research 2025
Gold
Mariah Hay
Ethics in Tech Education: Designing to Provide Opportunity for All
2018 • Enterprise Experience 2018
Gold
Russ Unger
Getting Out from Under Everyone: How to Escape the Paralysis of Getting Started
2016 • Enterprise UX 2016
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 2: Evals are your moat
2025 • Rosenfeld Community
Edward Cupps
The Principal Path: Journeying from Management to Individual Contributor
2021 • Design at Scale 2021
Gold
Maria Skaaden
Continuous Design: One eye on the horizon and the other on the next wave
2018 • DesignOps Summit 2018
Gold
Rachel Posman
"Ask Me Anything" with Rachel Posman and John Calhoun, Authors of the Upcoming Rosenfeld Book, The Design Conductors
2024 • DesignOps Summit 2024
Gold
Bria Alexander
Opening Remarks Day 2
2024 • Advancing Research 2024
Gold
Alex Hurworth
Designing a Contact Tracing App for Universal Access
2020 • DesignOps Summit 2020
Gold
Sylvie Abookire
A Civic Designer's Guide to Mindful Conflict Navigation
2022 • Civic Design 2022
Gold
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Chris Engledowl
A Mixed Method Approach to Validity to Help Build Trust
2023 • QuantQual Interest Group
Michele Marut
Research Repositories Reconsidered
2019 • DesignOps Community
Amy Marquez
INVEST: Discussion
2018 • Enterprise Experience 2018
Gold
Rachel Radway
The Many Paths Of Design Operations
2022 • DesignOps Summit 2022
Gold

More Videos

Ariel Kennan

"We have to shift from mechanistic linear thinking to complex systems thinking."

Ariel Kennan

Civic Design in 2022

January 13, 2022

Russ Unger

"Manhole cover questions belong in the past. Focus on real skills and relevant experience instead."

Russ Unger

Onboarding: The Ecosystem, not the Afterthought

November 7, 2017

Daniel Korczynski

"There's no way to deny it: every industry needs to adapt to AI, but nobody really knows how yet."

Daniel Korczynski

Why AI Is Bad at Research (and how to make it actually useful)

March 10, 2026

Peter Van Dijck

"The bot doesn’t summarize books because we’re a publisher and don’t want to cannibalize book sales—it points users to the original sources."

Peter Van Dijck Louis Rosenfeld

Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood

June 14, 2024

Christian Bason

"After 10 years, managers who first encountered civic design still believe it’s the right approach and continue to use it."

Christian Bason

Innovating With People: Unleashing the Potential of Civic Design

December 8, 2021

Patrizia Bertini

"If designers are spending time on non-design work, they are not doing design — and that’s the real problem."

Patrizia Bertini

DesignOps + KPIs = Measure your Impact!

January 8, 2024

Dr. Jamika D. Burge

"AI cannot do empathy; moderated usability testing requires the human ability to pivot and connect."

Dr. Jamika D. Burge Nick Fine Alexandra Jayeun Lee Greg Nudelman Bo Wang

How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]

August 31, 2023

Patrick Boehler

"The biggest shift is the power moving from supply side to demand side in media."

Patrick Boehler Madison Karas

The service shift: transforming media organizations to create real value through design

November 19, 2025

Rebecca Gimenez

"Our work helps create space to zoom out and have conversations about the future vision."

Rebecca Gimenez

Work in Progress: Service Design at Airbnb

December 3, 2024