Know What's Happening in AI

🔮 Autoresearch and the Experimental Society

Autoresearch is an open‑source framework that runs autonomous experimental loops, letting a human define goals while an AI iterates toward optimal results. Andrej Karpathy’s initial test trained a GPT‑2‑scale model two days faster and discovered 20 genuine improvements, a speed gain of 11%. Shopify CEO Toby Lütke applied the tool to his internal model, generating 37 overnight experiments that produced a 0.8‑billion‑parameter model outperforming a 1.6‑billion‑parameter version by 19%. The author has extended the concept to business decision‑making with a variant called AutoBeta, which uses synthetic judges to score outputs.