Summary
In this talk, Johanna Kollmann will discuss how true insights can inform product strategy, with direct impact on the roadmap and metrics. Drawing on her experience as a research lead and product manager, Johanna will share case studies and tools that are relevant for researchers, designers, and product leaders. Stick around to join the conversation and ask Johanna your questions during our post-session Q+A, moderated by Christian Crumlish.
Key Insights
-
•
Research that only validates design artifacts risks being undervalued by product leadership focused on broader strategic outcomes.
-
•
Separating research questions from interview questions improves research clarity, collaboration, and outcome relevance.
-
•
Insights must go beyond facts to explain why something happens and its meaning for product or business strategy.
-
•
Confirmation bias from domain experts turned product managers can hinder objective interpretation of research data.
-
•
A simple collaborative analysis tool mapping observations, meanings, and business relevance facilitates insight development and shared understanding.
-
•
Framing insight headlines in terms of strategic goals like adoption garners more leadership attention than tactical usability language.
-
•
Strategic insights can reveal systemic blockers outside the immediate product team’s control but crucial for impact, requiring escalation.
-
•
Visual tools like quadrant diagrams enable non-traditional product managers to communicate research-based priorities effectively with leadership.
-
•
Human-centric metrics such as employee well-being and client relationships complement business metrics and support successful digital transformation adoption.
-
•
Performance forums that integrate research, design, product management, and analytics facilitate alignment on mission-level goals and coordinated action.
Notable Quotes
"The product leadership really doesn’t see the value in research and they’re thinking about shutting the research team down."
"Research was completely evaluative and tactical, positioned as serving design by validating wireframes and high fidelity prototypes."
"Design strategy focuses on providing a framework for developing design solutions that support a given product strategy, whereas product strategy addresses the business model, the roadmap, and prioritizing requirements - Frank Guo."
"The most significant source of confusion is the difference between research questions and interview questions - Erica Hall."
"Insights are unexpected discoveries about how things work and how to make them work better - Gary Klein."
"Confirmation bias is when we ignore or explain away data that doesn’t support what we already believe - Nina Belk."
"If you frame it as poor first experience risks a negative impact on adoption, you get way more eyeballs and attention."
"The service wasn’t achieving the impact it was set out to have because the regulations governing everything else were not fit for purpose."
"A simple quadrant diagram helped our product manager tell the story to leadership and made him look good."
"What we measure is super important because it determines what people pay attention to. Without governance, priorities and ratings become outdated."
Or choose a question:
More Videos
"There is no solid way to control the course of your re-platforming project; being flexible is essential."
Malini RaoLessons Learned from a 4-year Product Re-platforming Journey
June 9, 2021
"Start small, revisit a past study, synthesize related findings, or take a step towards creating something like a playbook for your own organization."
Katie HansenFinding the unknown in the known: Harnessing meta-analysis and literature review
March 12, 2025
"UXers are less satisfied because we have failed to set proper expectations about what the real work of UX is."
Peter MerholzThe Trials and Tribulations of Directors of UX
July 13, 2023
"We have been good with not having fake or hallucinated answers so far, and retaining context is key."
Maria Rosala Shivanjali M.Research Repositories
March 12, 2026
"Gesture and embodied actions will be a key tool for understanding user experience as computing moves beyond traditional screen-based interactions."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
"Sustainable teams require visible shared growth paths; designers’ growth should be supported, not accidental."
Ebru NamaldiDesigning the Designer’s Journey: Scaling Teams, Culture, and Growth Through DesignOps
September 11, 2025
"The equity executive order calls for a whole-of-government transformation—think about the scale of that."
Aaron Stienstra Lashanda HodgeLeveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government
December 8, 2021
"Make a proof of concept before investing a lot more time and energy into a design system."
Dave Malouf Amy ThibodeauPanel: Design Systems and Documentation
November 7, 2017
"Math models don’t just provide numerical precision, they can be inspirational for thinking about UX spread."
Scott PlewesWhy Isn't Your UX Approach Going Viral?: A Mathematical Model
March 28, 2023
Latest Books All books
Dig deeper with the Rosenbot
How do I determine the shelf life or expiry date of different types of research insights?
How do organizations integrate customer feedback, survey data, and interview transcripts into a single research repository?
How does involving more senior researchers in the field improve research outcomes when AI handles transcript processing?