Tag

#monitoring

2 stories tagged monitoring.

LLM performance drift: within-day variance of 2.8 points and between-day variance of 8.4 points on a normalized 0 to 100 composite score, showing between-day variance is 3x larger across 31,352 hourly measurements

LLM performance drift: why your benchmark scores keep moving

LLM performance drift is the silent regression of API-served models over time. Between-day variance hits 8.4 points, three times the within-day noise of 2.8.

Lars Cornelissen · Sep 7, 2026

SentinelBench related success data showing baseline agents at 5.6 percent on 1 hour and 2 hour monitoring tasks, while SentinelStep reached 33.3 percent at 1 hour and 38.9 percent at 2 hours.

Research

SentinelBench tests whether AI agents can wait well

SentinelBench is a 100-task benchmark for monitoring agents. Use it to test patience, latency and tool spend before you ship.

Lars Cornelissen · Jun 6, 2026