Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

[Demo] Stress-testing GenAI in user research synthesis
Gold
Tuesday, June 4, 2024 • Designing with AI 2024
Share the love for this talk
[Demo] Stress-testing GenAI in user research synthesis
Speakers: Yulya Besplemennova
Link:

Summary

In this high-pressure scenario, the challenge was to conduct 17 user interviews in three days and synthesize a comprehensive report in just one additional day. I’ll explore how we used AI to streamline the research process, from transcription to synthesis, and how tools like ChatGPT contributed to efficient data processing and insight generation. We’ll reflect on the potential and pitfalls of using AI in accelerated user research, from practical aspects to more philosophical considerations on potential changes to the research process. Takeaways Practical insights into integrating AI with traditional research methodologies to expedite the research process An overview of the effectiveness of AI transcription and synthesis tools in real-world research scenarios Critical examination of AI's role in data processing and how it compares with human analysis Strategic considerations for service designers when employing AI to support rapid user research Reflection on the ethical implications and potential impact on the quality of insights and researcher well-being when relying on AI to speed up research processes

Key Insights

  • Generative AI can speed up the research synthesis process, especially in textual content generation.

  • AI functions better with structured guidance, requiring human input to achieve optimal results.

  • The reliance on AI can alleviate cognitive overload during high-pressure projects.

  • AI's capacity for clustering and generating summaries can enhance data analysis effectiveness.

  • It's critical to present data in a format AI understands to improve output relevance and quality.

  • Collaboration with AI is akin to working with an intern; it requires training and reminders to be effective.

  • While AI can enhance productivity, it may lack some nuances that humans can naturally discern in data.

  • Maintaining the depth of human insights in research while utilizing AI is a crucial challenge.

  • AI has the potential to stimulate creativity by offering numerous generic inputs that can lead to innovative thinking.

  • The integration of AI in research processes necessitates careful management to avoid shallow insights in the rush for efficiency.

Notable Quotes

"AI can really help to speed up certain synthesis moments."

"I was feeling very stressed and worried, and I decided that it was a perfect moment to try the AI tools."

"I approached it as a kind of human colleague, a collaborator."

"AI behaves like an alien intern, not capable of making sense of some things that are easy for us."

"It actually accelerates and simplifies the exploration of various clustering options."

"AI has this great capacity to generate textual descriptions along a given format."

"The biggest value here is helping to manage cognitive overload."

"AI can stimulate human thinking and creative processes by providing multiple inputs."

"I think it's really crucial to have your own experience to evaluate outputs and guide the AI."

"How can we ensure that research done with AI maintains depth for the sake of speed and efficiency?"

More Videos

Jacqui Frey

"What if part of our job was to remove the friction in the environment?"

Jacqui Frey

Flow and Superfluidity for Design Orgs

November 7, 2018

Laura Gatewood

"It's about how you want your recipients to feel when they receive your message."

Laura Gatewood Laine Prokay

Beyond Buzzwords: Adding Heart to Effective Slack Communication

September 23, 2024

Johanna Kollmann

"You can facilitate space for developing insights through collaborative analysis techniques."

Johanna Kollmann

Insights-Driven Product Strategy: Get your Research to Count

December 6, 2022

Bria Alexander

"We're closing out Design Ops 2024 with innovation curated by John Kuda."

Bria Alexander

Day 3 Welcome

September 25, 2024

Billy Carlson

"Don't limit yourself to creating everything yourself—take screenshots, combine them, and really explain what you're going for visually."

Billy Carlson

Ideation tips for Product Managers

December 6, 2022

Catherine Dubut

"It's easy to stay immersed in digital, but physical contexts matter immensely for designing multi-channel experiences."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Kim Holt

"Trust is the foundation of our team's culture and needs to be maintained during changes."

Kim Holt Emma Wylds Pearl Koppenhaver Maisee Xiong

A Salesforce Panel Discussion on Values-Driven DesignOps

September 8, 2022

Adrian Howard

"90% of everything is crud, including the people we work alongside."

Adrian Howard

Sturgeon’s Biases

September 25, 2024

Asia Hoe

"It's important to assume positive intent."

Asia Hoe

Partnering with Product: A Journey from Junior to Senior Design

November 29, 2023