Inside Gen 13: How We Built Our Most Powerful Server Yet

Why It Matters

Gen 13 dramatically expands Cloudflare’s edge capacity and reduces data‑center expansion costs, setting a new efficiency benchmark for large‑scale content‑delivery networks.

Key Takeaways

• 192‑core AMD EPYC Turin doubles compute density.
• Dual 100 GbE NIC quadruples network bandwidth per server.
• DDR5‑6400 memory and PCIe 5.0 storage boost throughput.
• Up to 50% better performance‑per‑watt reduces operational costs.
• PCIe encryption extends data protection across the bus.

Pulse Analysis

The shift to a 192‑core AMD EPYC Turin processor reflects a broader industry move toward massive parallelism at the edge. Cloudflare’s FL2 rewrite, written in Rust, reduces reliance on large L3 caches, allowing the 9965’s modest per‑core cache to be offset by sheer core count. This architecture enables near‑linear scaling of request handling, a critical advantage for services that must process billions of HTTP requests daily while maintaining low latency.

Memory and storage upgrades are equally strategic. By populating all twelve DDR5‑6400 channels, Gen 13 achieves 614 GB/s of peak bandwidth, eliminating memory starvation for high‑concurrency workloads. The transition to PCIe 5.0 NVMe drives not only expands capacity to 24 TB but also halves latency compared with Gen 12’s PCIe 4.0 devices. Coupled with dual 100 GbE NICs, the server can sustain the doubled compute output without network bottlenecks, while PCIe encryption safeguards data across every bus transaction.

From a business perspective, Gen 13’s 50% improvement in performance‑per‑watt translates into lower power and cooling expenses, directly reducing data‑center expansion budgets. The modular Project Argus DC‑SCM 2.0 architecture preserves security continuity and simplifies firmware recovery, essential for a globally distributed network. By future‑proofing with DDR5, PCIe 5.0, and CXL support, Cloudflare positions itself to adopt emerging accelerators and storage technologies without wholesale hardware refreshes, reinforcing its competitive edge in the CDN and edge‑computing markets.