Engineering
ESQ-Bench: NL2SQL on Oracle is quietly wrong
On the 550-query ESQ-Bench Oracle NL2SQL benchmark, GPT-4o falls from 79.8 to 57.2 percent as schemas grow, and 92 percent of passes diverge.
#silent-divergence
1 story tagged silent-divergence.