Tag

#llm-deployment

1 story tagged llm-deployment.

Horizontal bar chart comparing three AUC scores for MoE route flips: flip detection at 0.772, harm prediction given a flip at 0.490, and benefit prediction at 0.499. The last two are at chance level. Source: arXiv 2608.11212.

Detecting MoE route flips works, fixing them is near-random

MoE route flips are tokens that switch experts under KV-cache quantization. Detection hits AUC 0.772 but harm prediction is at chance, bounding selective repair.

Lars Cornelissen · Aug 14, 2026