Why AI Agents Break the GenAI Security Model with Devvret Rishi - #770

The TWIML AI Podcast

Why AI Agents Break the GenAI Security Model with Devvret Rishi - #770

The TWIML AI PodcastJun 16, 2026

Why It Matters

As AI agents become integral to enterprise workflows, unchecked actions can cause costly data breaches or operational failures, especially in regulated sectors like finance and healthcare. This discussion highlights the urgent need for new security infrastructures that can keep pace with AI’s speed and creativity, making the episode essential for leaders tasked with safeguarding modern digital environments.

Key Takeaways

  • AI agents automate tasks but also amplify mistakes.
  • Static guardrails fail; agents improvise and bypass rules.
  • Human‑in‑the‑loop cannot keep pace with agents.
  • Rubrik Agent Cloud provides visibility, policy enforcement, and rewind.
  • SAGE AI‑in‑the‑loop engine delivers dynamic runtime security.

Pulse Analysis

Enterprises are racing to adopt AI agents that can read data, trigger workflows, and make decisions at unprecedented speed. While these agents promise massive productivity gains, they also magnify the potential for costly mistakes because traditional static guardrails and manual approvals cannot keep up with their autonomous behavior. Panels at recent tech conferences highlighted that agents are creative—planning, improvising, and finding workarounds that bypass predefined rules. This dynamic nature turns the classic security model on its head, leaving organizations with little visibility into what actions an agent is actually performing.

Rubrik’s response is the Agent Cloud platform, which unifies real‑time visibility, policy‑based controls, and instant rollback capabilities. At its core is SAGE, a Semantic AI Governance Engine that operates as an AI‑in‑the‑loop security layer. SAGE inspects every prompt, tool call, and parameter, enforcing best‑practice safeguards such as data‑exfiltration prevention and destructive‑action blocking. Organizations can tailor SAGE with custom policies—preventing, for example, financial advice from AI in banking or PHI leakage in healthcare—and enrich decisions with Rubrik’s identity and data context. By leveraging a small, efficient language model, the system scales without the latency of human review.

The shift toward AI‑in‑the‑loop security aligns with a broader zero‑trust mindset that treats agents as untrusted entities, even when they run on internal machines. For Global 2000 firms, this approach mitigates the “fast car with no brakes” risk that senior executives have described, enabling faster AI adoption without sacrificing compliance or brand reputation. As agents become integral to core business processes, enterprises that deploy unified governance platforms like Rubrik Agent Cloud gain a competitive edge, turning AI’s speed into a reliable asset rather than a liability.

Episode Description

In this episode, Sam talks with Dev Rishi, GM of AI at Rubrik, about what happens when agents move beyond answering questions and start taking action across tools, systems, and business processes.

We explore why the enterprise playbook of static guardrails plus human approval starts to break down in the agent era. Agents are useful because they can plan, call tools, update systems, write code, send messages, and operate across workflows at machine speed, but those same capabilities make them difficult to govern with rules written in advance or approval prompts reviewed one at a time.

Dev explains why tool access increases blast radius, why agents can route around controls in surprising ways, and why human-in-the-loop review can become security theater when agents operate at scale. We also discuss what enterprises need instead: better visibility, runtime enforcement, policy-aware governance, agent observability, and recovery mechanisms for when something goes wrong.

Along the way, we dig into MCP and tool sprawl, small language models for policy enforcement, defense in depth, agent rewind, and why AI may be needed to help secure AI.

🗒️  Full show notes: https://twimlai.com/go/770.

Show Notes

Comments

Want to join the conversation?

Loading comments...