AI for dummies
K2 Horizon 7B explained: small model, big-model results
IFM's K2 Horizon 7B open-weights model matches models four times its size on coding and math. What beginners should know before trying it.
#local-ai
4 stories tagged local-ai.
AI for dummies
Muse Glimmer 30B: Meta's open-weights model for local agents
Meta's 30B open-weights Muse Glimmer fits on one RTX 3090 and reaches 280 tokens per second, built for local agentic workflows.
AI for dummies
Bonsai 27B puts a big AI model on your phone
Storing each parameter as a single bit lets Bonsai 27B fit 27 billion parameters into 3.9 GB and run on an iPhone. Here is what 1-bit quantization costs.
AI for dummies
How MTPLX v2 makes local AI on Mac twice as fast
MTPLX v2 uses multi-token prediction to run local AI on Apple Silicon Macs up to 2.24x faster. Here is what beginners need to know.