SULLIVAN & CROMWELL APOLOGIZES FOR AI-GENERATED FALSE CITATIONS

The firm filed the apology with the US Bankruptcy Court for the Southern District of New York. The motion included false legal references that were generated by an AI tool, prompting the mea culpa to the judge. The incident underscores growing concerns about the use of generative AI in legal work. Law firms have increasingly adopted AI tools to streamline document drafting and research, but the technology remains prone to producing fabricated citations and inaccurate information—a phenomenon known as "hallucination." This is not an isolated incident. Several lawyers have faced sanctions and professional consequences for submitting AI-generated briefs containing false case citations. The American Bar Association and state bar associations have begun issuing guidance on responsible AI use in legal practice, emphasizing that attorneys remain responsible for verifying all submissions. The case highlights the need for human oversight when deploying AI in high-stakes legal proceedings where accuracy is paramount.