Know What's Happening in Technology

2,000 Robots Walk Into a Shop: Simulated A/B Testing (2026) – Shopify

Shopify’s SimGym simulates up to 2,000 cloud‑browser robots to run instant A/B tests on storefront changes, eliminating weeks‑long traffic waits. The system pairs Browserbase’s Chromium sessions with an open‑source 120‑billion‑parameter Mixture‑of‑Experts model, optimized through MXFP4 quantization, FP8 KV‑cache, and custom FlashInfer kernels on NVIDIA Blackwell GPUs. These hardware and software tweaks cut inference latency by roughly 20 % and boost daily throughput by double‑digit percentages, making simulated testing viable even for zero‑traffic merchants. Ongoing enhancements such as MIG partitioning and speculative decoding promise further latency reductions and higher throughput.