Recent Posts
Social•Dec 15, 2025
2.6k‑parameter RL Model Matches 62B Baseline on GSM8k
Oh My! I just built a new RL-native system with 2.6k parameters that matches a specialized 62B model from a 2024 paper, specifically on GSM8k. That's over 20,000,000x smaller than the baseline — but the approach is so different the traditional comparison doesn't make sense? ;-) https://t.co/KE7XDm79Ey
By Alex J. Champandard
Social•Dec 1, 2025
Intellect-3 Beats Larger Models with 34% Gain
If the initial benchmarks scores (and graphs used for PR) showcased a 3x reduction in size for the same performance, I think the broader public reception would have been less tepid. Just looking at this, it just seems 7% behind other...
By Alex J. Champandard
Social•Nov 27, 2025
Tiny 6k Model Replicates Behaviors of Massive Systems
A latent process that operates over plans? I've been working on this recently! What's most fascinating to me: my 6k parameter system can match aspects of models 100,000x bigger. Scaling laws apply very differently too... 🤔
By Alex J. Champandard
Social•Nov 25, 2025
Opus 4.5 Mitigates Cursor AI Bugs, Not Solely Responsible
For Gemini 3, I don't rule out bugs in @cursor_ai — as many new features don't work, worktrees getting trashed or even renamed (!) mid-way through agent working. But since Opus 4.5 manages around those bugs, it can't...
By Alex J. Champandard