5 stories tagged local-ai.
Qwen 3.8 27B is an open-weights AI model that fits in a 17GB file and runs on your laptop. It scores 52 on the Artificial Analysis Intelligence Index, tying OpenAI's hosted GPT-5.6 Luna.
Qwen 3.8 27B is a free, open AI model with 27 billion parameters that runs on a single GPU. It scores 61.7 on SWE-bench Pro, up from 53.5.
Muse Glimmer is Meta's new 30B open-weights model built for local agentic workflows. It fits on one RTX 3090 and hits 280 tokens per second.
1-bit quantization is a compression trick that shrinks AI models by storing each parameter as one bit. Bonsai 27B uses it to fit a 27 billion parameter model in 3.9 GB, running on an iPhone.
MTPLX v2 uses multi-token prediction to run local AI on Apple Silicon Macs up to 2.24x faster. Here is what beginners need to know.