The Evaluation Loop
Evaluation as a control loop, not a final exam.
REFERENCE EIGHT DOMAINS
Every evaluation concept, on one map.
Browse by domain. Scenes open the animated exhibits; entries are the distilled reference points.
The measurement loop, capability vs alignment, and static versus dynamic suites.
Capability vs Alignment
Can it, and does it the way we intended? Two independent axes.
Static vs Dynamic Suites
Frozen item banks versus live arenas.
Eval-Driven Development
Write the eval before the prompt change.