Research
Detecting MoE route flips works, fixing them is near-random
Under KV-cache quantization, MoE route flips are detectable at AUC 0.772, but predicting their harm is at chance, which limits selective repair.
#llm-deployment
1 story tagged llm-deployment.