Why Legal AI Fails without Trusted Data: Key Takeaways From Our Denodo Webinar

Why It Matters

Without a trusted data foundation, legal AI cannot deliver defensible advice, exposing firms to compliance risk and eroding client confidence; a unified data layer is essential for scaling AI value and maintaining competitive advantage.

Key Takeaways

• Legal AI stalls due to untrusted, fragmented data, not model weakness
• Trust requires unified, governed data across core, legacy, and real-time sources
• Pilot projects succeed in isolated environments but fail when scaled operationally
• Agentic AI amplifies need for explainable, permission‑aware data foundations
• Defensible data layer reduces manual reconciliation, boosting client responsiveness

Summary

The Denodo webinar, hosted by Legal IT Insider’s Caroline Hill, examined why legal‑focused artificial intelligence projects frequently stall despite sophisticated tools. Speakers argued that the root cause is not algorithmic weakness but the inability of law firms to rely on the data feeding those models.

Participants highlighted fragmented data across core databases, legacy systems, and transient real‑time feeds, which undermines governance, confidentiality, and jurisdictional compliance. Pilot implementations succeed in sandboxed environments, yet when scaled they falter because the underlying data is incomplete, outdated, or lacks proper permission controls. The discussion also warned that emerging agentic AI will intensify these trust requirements.

Errol Rodri emphasized, "Legal AI doesn’t stall because models are weak; it stalls because the data beneath them isn’t trusted," and added that legal decisions must survive both the moment of recommendation and later audit scrutiny. He cited a case where a firm spent hours reconciling billing history, matter experience, and regulatory insights spread across disparate repositories, losing responsiveness and opportunities.

The takeaway for firms is clear: invest in a unified, governed data layer—such as Denodo’s integration platform—to provide explainable, permission‑aware, and traceable information. Doing so not only enables AI to move from proof‑of‑concept to production but also safeguards the profession’s core requirement for defensible advice.

Original Description

Legal AI adoption has accelerated rapidly over the past two years, yet many law firms are discovering that progress stalls when pilots move into production. In a recent Talking Tech webinar hosted by Legal IT Insider, Errol Rodericks, marketing director at Silicon Valley data management company Denodo, unpacked why legal AI initiatives so often fail — and why the problem is rarely the technology itself.

The core issue, Rodericks argued, is trust. While AI tools perform well in controlled pilots, they struggle in live environments where they must operate across fragmented, siloed and inconsistently governed data. Law firms may have sophisticated CRM, billing, document management and analytics systems, but these tools were designed to support individual processes, not to provide a consistent, governed enterprise-wide view of data. As a result, lawyers are forced into manual reconciliation, exporting spreadsheets and relying on yesterday’s truth — all of which undermine confidence in AI outputs.

This lack of trust is particularly acute in the legal sector. Unlike many other industries, law firms must be able to stand behind every recommendation not only at the point of decision-making, but months or years later during audits, disputes or regulatory scrutiny. If lawyers cannot trust the inputs, they simply cannot rely on the outputs. As Rodericks put it during the webinar, legal AI does not fail because models are weak — it fails because the data beneath them is not trusted.

The webinar also explored where firms feel the operational pain most sharply. Preparing pitches and panel submissions was a recurring example: client billing history, prior matter experience, regulatory insights and sector benchmarks often sit in disconnected systems. Firms lose time, responsiveness and opportunities as teams spend hours assembling data rather than advising clients.

A public-domain case study with BCLP illustrates what becomes possible when those barriers are removed and we looked at some of the takeaways of a podcast with BCLP's senior data architecture manager Ben Legge.

Looking ahead, the discussion highlighted that emerging approaches such as agentic AI and Model Context Protocols (MCP) will only increase the pressure on data foundations. MCP can connect different data sources, but it cannot act as a filter for quality.

The clear takeaway for firms: if AI is to deliver real value, trusted data must be treated as a strategic asset — not an afterthought.

👉 Watch the full webinar replay to hear the discussion in depth, including practical examples and lessons from both legal and financial services.