State of AI

Transformer Architectures, Discrete Diffusion, and Materials Discovery

The latest AI research roundup highlights a pivot from scaling raw compute toward efficiency‑first designs. Notable advances include calibrated sparse attention that accelerates text‑to‑video diffusion without retraining, and an object‑centric self‑improving loop that refines image generation alignment autonomously. A hybrid LLM‑driven evolutionary search (LLEMA) demonstrates practical materials discovery by coupling scientific intuition with synthesis constraints. Additional work demystifies transformer activation spikes as architectural artifacts and introduces cubic discrete diffusion, setting a new token‑based ImageNet benchmark.