EVERY SIGNAL, SORTED.

AI Agents, Failure Analysis, Training Data, Evaluation and Human Review

Fifty thousand agent mistakes became training data, but the teacher wrote the diagnoses

The Agent Error Dataset turns failed tool-using runs into diagnoses, corrections and training examples. Its strongest result is also its best warning: a model can learn the label system without proving the labels are right.