Tag

#fine-tuning

2 stories tagged fine-tuning.

Why LoRA fails at multi-step procedural tasks

LoRA fine-tuning is the go-to method for teaching LLMs new skills cheaply. A 2026 arXiv paper shows it fails to internalize multi-step procedures, degrading sharply when chains exceed four steps.

Lars Cornelissen · Jul 28, 2026

Open-weight model comparison showing Inkling at 975B total parameters and 41B active, Inkling-Small at 276B total and 12B active, and Hy3 295B at 295B total and 21B active

AI for dummies

Inkling 975B: Thinking Machines releases open-weights model

Inkling is Thinking Machines Lab's first open-weights model. At 975B parameters with 41B active and Apache 2.0 licensing, it targets fine-tuning, not frontier benchmarks.

Lars Cornelissen · Jul 17, 2026