"Instead, Claude Just Made Up More Stuff"

Key Takeaways

• AI Claude hallucinated legal citations in court brief
• Lawyer submitted AI output without final attorney review
• Court imposed $1,000 sanction for Rule 11 violation
• Mandatory human lawyer check required for all citations
• Case signals heightened scrutiny of AI in legal work

Pulse Analysis

The legal profession has embraced generative AI tools like Claude for drafting pleadings, memos, and research, attracted by speed and cost savings. However, the Brooks v. Lowes Home Centers decision illustrates a critical flaw: AI can fabricate citations, a phenomenon known as "hallucination." In this case, the fabricated quotations slipped past an initial clerk review and were filed with the court, exposing the firm to professional misconduct claims.

Rule 11 of the Federal Rules of Civil Procedure obligates attorneys to ensure the factual and legal accuracy of any material submitted to the court. Courts are increasingly treating AI‑generated errors as violations of that duty, especially when lawyers rely on the technology without a substantive human check. Recent disciplinary actions across jurisdictions echo the same theme, reinforcing that ignorance of AI risks is no longer a viable defense. The $1,000 sanction serves both as a penalty and a warning that the legal community must adapt its ethical frameworks to incorporate AI oversight.

Practitioners can mitigate these risks by instituting layered review processes: initial AI drafts should be treated as rough notes, followed by thorough verification of every citation and quotation by a licensed attorney. Firms are also investing in AI‑audit tools that flag potential hallucinations before human review. As regulators contemplate formal guidelines, the industry is likely to see standardized best‑practice protocols, mandatory training, and possibly new rules that explicitly address AI usage. Staying ahead of these developments will be essential for law firms that wish to leverage AI responsibly while safeguarding client interests and professional integrity.