Peter Van Dijck

" You become part of the infrastructure when your customer understanding is embedded in files run by AI systems and engineers. "

" Start planning for evals on day one, it's not QA, it's an ongoing activity. "

" You can’t just be a designer adapting UX workflows assuming everybody else’s workflow stays the same; everything is changing with AI. "

" Model companies are students in a classroom wanting good points—they’re happy to run external expert evals to improve. "

" Evals are a product and UX skill; learning them lets you make these systems do what you want. "

" Nobody really knows what all this AI stuff is about yet, so we’re experimenting with it ourselves. "

" Language is hard, and we use anthropomorphic words like reasoning and thinking to describe what the model does technically. "

" You have to build a detailed definition of what is good for my system to do meaningful automated evals. "

" Models are stateless; they take input and give output and forget everything immediately after. "

" Everything’s changing really quickly—if you don’t revise your plan in a few months, you’re building for a world that’s already outdated. "

" Chatbots aren’t just the language model—they have structure around intent classification, safety checks, and session memory simulation. "

" There’s a lot of steps behind the scenes to make conversations useful and safe. "