Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

[Demo] Stress-testing GenAI in user research synthesis
Gold
Tuesday, June 4, 2024 • Designing with AI 2024
Share the love for this talk
[Demo] Stress-testing GenAI in user research synthesis
Speakers: Yulya Besplemennova
Link:

Summary

In this high-pressure scenario, the challenge was to conduct 17 user interviews in three days and synthesize a comprehensive report in just one additional day. I’ll explore how we used AI to streamline the research process, from transcription to synthesis, and how tools like ChatGPT contributed to efficient data processing and insight generation. We’ll reflect on the potential and pitfalls of using AI in accelerated user research, from practical aspects to more philosophical considerations on potential changes to the research process. Takeaways Practical insights into integrating AI with traditional research methodologies to expedite the research process An overview of the effectiveness of AI transcription and synthesis tools in real-world research scenarios Critical examination of AI's role in data processing and how it compares with human analysis Strategic considerations for service designers when employing AI to support rapid user research Reflection on the ethical implications and potential impact on the quality of insights and researcher well-being when relying on AI to speed up research processes

Key Insights

  • Generative AI can speed up the research synthesis process, especially in textual content generation.

  • AI functions better with structured guidance, requiring human input to achieve optimal results.

  • The reliance on AI can alleviate cognitive overload during high-pressure projects.

  • AI's capacity for clustering and generating summaries can enhance data analysis effectiveness.

  • It's critical to present data in a format AI understands to improve output relevance and quality.

  • Collaboration with AI is akin to working with an intern; it requires training and reminders to be effective.

  • While AI can enhance productivity, it may lack some nuances that humans can naturally discern in data.

  • Maintaining the depth of human insights in research while utilizing AI is a crucial challenge.

  • AI has the potential to stimulate creativity by offering numerous generic inputs that can lead to innovative thinking.

  • The integration of AI in research processes necessitates careful management to avoid shallow insights in the rush for efficiency.

Notable Quotes

"AI can really help to speed up certain synthesis moments."

"I was feeling very stressed and worried, and I decided that it was a perfect moment to try the AI tools."

"I approached it as a kind of human colleague, a collaborator."

"AI behaves like an alien intern, not capable of making sense of some things that are easy for us."

"It actually accelerates and simplifies the exploration of various clustering options."

"AI has this great capacity to generate textual descriptions along a given format."

"The biggest value here is helping to manage cognitive overload."

"AI can stimulate human thinking and creative processes by providing multiple inputs."

"I think it's really crucial to have your own experience to evaluate outputs and guide the AI."

"How can we ensure that research done with AI maintains depth for the sake of speed and efficiency?"

More Videos