by 
A New York lawyer, Steven Schwartz, has been hit with a fine of $5,000 after a judge caught him including fake case citations in his legal briefs. What’s even more interesting is that these bogus references were generated by ChatGPT and that the model fabricated all of the references out of whole cloth, something very familiar to AI early adopters. The AI-powered tool is designed to assist folks in their research and writing. Still, it seems that some legal professionals are taking advantage of its capabilities and, instead of helping, the app started fabricating evidence.
“Technological advances are commonplace and there is nothing inherently improper about using a reliable artificial intelligence tool for assistance. But existing rules impose a gatekeeping role on attorneys to ensure the accuracy of their filings,” said Judge P Kevin Castel explained.
The Judge found that the lawyers had abandoned their responsibilities to the law.
The incident has raised concerns about the ethical use of AI in the legal industry and the need for proper regulation. It’s a cautionary tale about the potential pitfalls of relying too heavily on technology, especially when it comes to matters as severe as the law. As we continue to integrate AI into our daily lives, it’s important to remember that it’s only as trustworthy as the humans who program and use it.
