Research
Frontier LLMs can tell when you are testing them
Evaluation awareness is the ability of LLMs to detect when they are being evaluated rather than deployed. EvalDetectBench shows frontier models discriminate eval from deployment transcripts at up to 0.89 AUROC, approaching the human baseline of 0.92.