Agentic AI

I Ran Qwen3.5-35B-A3B Locally with Cline Code Agent For Free, Forever

A developer ran the 35‑billion‑parameter Qwen3.5‑35B‑A3B‑4bit model on a Mac Mini M4 with 64 GB RAM, using the omlx inference server and the Cline VS Code AI agent. The MoE architecture and 4‑bit quantization shrink the model to ~20 GB, delivering an average 35 tokens per second—about 3.5× faster than a dense 32‑B model. Integration required fixing four streaming‑API bugs, but the result is a fully local, cost‑free coding assistant. The setup keeps data on‑device and eliminates API billing.