John Hammond

The Payload Podcast #005 - AI with Shane Caldwell

The Payload Podcast #005 brings together Shane Caldwell of Dreadnode and host Max Harley to discuss how artificial‑intelligence is reshaping cybersecurity, from synthetic data generation for pen‑testing to the emerging challenges of autonomous tool‑driven agents. Caldwell explains Dreadnode’s “Worlds” project, which creates realistic training data that lets large language models learn to perform red‑team tasks. He also details Anthropic’s anti‑distillation safeguards, which inject fabricated tool‑call records to poison any downstream model that tries to distill the original data. The conversation notes that modern LLMs can now sustain 30‑50, even 100, sequential tool calls, a dramatic rise from the 15‑call limit a year ago. A vivid example cited is an evaluation where a model autonomously navigates an Active Directory Docker environment, issuing hundreds of tool calls without human input. Caldwell describes how harnesses such as Cloud Code or open‑source Codex enable LLMs to execute shell commands, while Anthropic’s summarised tool‑call responses aim to hide exact actions from potential attackers. These developments signal a turning point: as AI agents become capable of longer, self‑directed operations, both defenders and attackers will need new safeguards. Synthetic data pipelines and anti‑distillation techniques will be critical to prevent model leakage, while the industry must grapple with reliability and safety of truly autonomous AI systems.