Summary
If you’re a product manager, UX researcher, or any kind of designer involved in creating an AI product or feature, you need to understand evals. And a great way to learn is with a hands-on example. In this talk, Peter Van Dijck of the helpful intelligence company will walk you through writing your first eval. You will learn the basic concepts and the tools, and write an eval together. This talk is hands on; you can follow along, and there will be plenty of time for questions. You will go away with an understanding of the basic building blocks of AI evals, and with the confidence that you know how to write one. And more importantly, you’ll build some intuition, some product sense, around how the best AI products today are built, and how that can help you use them more effectively yourself.
Upcoming events
Building a Design Ops Practice that Really Works (Most of the Time)
More Videos
"Long COVID will teach us so much about invisible illnesses that are common but overlooked."
Kristen Honey"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design
November 18, 2021
"Screen reader users scored significantly lower in usability tests, reflecting the most effort in interpreting content."
Sam ProulxSUS: A System Unusable for Twenty Percent of the Population
December 9, 2021
"Only one designer exists for every 43 developers in many large enterprises."
Surya VankaUnleashing Swarm Creativity to Solve Enterprise Challenges
June 10, 2021
"Text-based campaigns have been very successful for reaching senior citizens."
Amanda Kaleta-Kott Lea Martin, PhDThe Joys and Dilemmas of Conducting UX Research with Older Adults
March 11, 2022
"Design maturity dictates how much influence design has outside the design group, impacting policy, finance, and other teams' decisions."
Sarah WilliamsVerizon_A Framework for CX Transformation
January 8, 2024
"Afrofuturism shows us the future must reckon with the past and center difference and diversity."
Devon PowersImagining Better Futures
March 9, 2022
"Those three retailers pivoted literally overnight under intense change management pressure."
Lada GorlenkoTheme 2 Intro
June 9, 2022
"I feel internally relaxed when I’m in a group and we’re talking with each other and I don’t have to strategize about what I’m going to say."
Alla WeinbergHow to Build and Scale Team Safety
January 8, 2024
"Slack is where the real party is happening for this conference."
Louis Rosenfeld Bria AlexanderOpening Remarks
March 27, 2023
