AI Hard Drive Shortage Makes Archiving the Internet Harder

Why It Matters

Escalating storage costs jeopardize the preservation of the internet’s historical record and inflate operating budgets for non‑profit knowledge platforms, potentially limiting public access to digital heritage.

Key Takeaways

• AI data‑center demand pushes SSD prices up 250%
• 2TB Samsung SSD price rose from $159 to $575
• Internet Archive needs 28‑30TB drives, now scarce
• Wikimedia cites storage cost spikes affecting Wikipedia infrastructure
• Micron exits consumer SSD market to prioritize enterprise AI customers

Pulse Analysis

The AI boom has reshaped the hardware market, turning storage into a premium commodity. Data‑center operators are hoarding high‑density SSDs and HDDs to feed massive model training workloads, driving up demand faster than supply chains can adapt. Prices tracked by sites like PC Part Picker show a consistent upward trajectory since late 2023, with many SKUs doubling or more. This pressure is amplified by component shortages in NAND flash and magnetic media, creating a secondary market where scalpers resell drives at marked‑up rates.

For digital preservation groups, the price shock translates into operational dilemmas. The Internet Archive, which ingests over 100 TB of new material daily, relies on 28‑30 TB drives that are now either unavailable or prohibitively expensive. Wikimedia’s 65 million‑article corpus faces similar constraints, prompting the foundation to extend hardware lifecycles and prioritize budget allocations. Both entities are exploring alternative strategies, such as tiered storage, data deduplication, and community‑driven hardware donations, yet the fundamental scarcity remains a barrier to scaling their archives.

Manufacturers are responding by reallocating capacity toward enterprise customers, as evidenced by Western Digital’s sold‑out 2026 inventory and Micron’s exit from the consumer SSD market. This shift underscores a broader industry realignment where AI workloads dictate product roadmaps. Analysts predict that unless supply chain bottlenecks ease or new fabrication capacity comes online, storage costs will stay elevated, compelling more organizations to adopt hybrid cloud‑on‑premise models or invest in proprietary storage solutions. The long‑term health of the internet’s archival ecosystem will hinge on how quickly the market can rebalance supply with the unprecedented demand generated by AI.