Peter Van Dijck

" You can’t just be a designer adapting UX workflows assuming everybody else’s workflow stays the same; everything is changing with AI. "

" Model companies are students in a classroom wanting good points—they’re happy to run external expert evals to improve. "

" Confidence scores from the model are not a good idea because the model has no memory. "

" Books are semantically very rich and thus pull content much more effectively in our vector database than conference talks. "

" Tool use lets the model decide itself when to call external APIs or services to get needed information. "

" It’s much easier to classify an answer than to generate an answer, and that’s why LLM as a judge works. "

" Synthetic data is exceedingly useful because you can generate it at scale for training and evals. "

" Building evals is like building tests to know if your AI system is good enough, and you can rerun them as models improve. "

" The product is imperfect, probably about 60 percent there, but if we get to 80 percent it will be a compelling tool for UX content. "

" We invented the ‘prompt deep dive’ technique to spend lots of time on one prompt to deeply understand it. "