> ## Documentation Index
> Fetch the complete documentation index at: /docs/llms.txt
> Use this file to discover all available pages before exploring further.

# How to Write Your First AI Eval

> A hands-on workshop on defining evaluation criteria, reading traces, and building an LLM judge for an AI agent.

In this workshop, SallyAnn DeLucia introduces practical ways to evaluate AI applications beyond informal vibe checks. She explains how evaluations differ from unit tests, surveys common evaluation approaches, and walks through reading a trace, defining pass or fail criteria, and building and iterating on an LLM judge in Arize's prompt playground.

[How to Write Your First AI Eval — SallyAnn DeLucia, Arize AI](https://www.youtube.com/embed/gv4w23xYj-0)

## What you'll learn

* Understand how evaluations complement unit tests for AI applications.
* Choose between LLM judges, decision models, code evaluations, annotations, and agent judges.
* Read an agent trace and turn expectations into clear pass or fail criteria.
* Build a dataset from traces and test an LLM judge.

[Watch the workshop on YouTube](https://www.youtube.com/watch?v=gv4w23xYj-0).
