You have a preview view of this article while we are checking your access. When we have confirmed access, the full article content will load.
The world’s smartest technology is no match for the U.S. tax code.
Artificial intelligence is used by the world’s military to operate sophisticated drones. It has replaced thousands of coders at the most advanced technology companies. It is even upending how cancer patients are treated, potentially saving lives.
Just don’t, whatever you do, use it to file your taxes.
To assess the technology’s ability to file a federal income tax return, The New York Times tested four A.I. chatbots — Google’s Gemini, OpenAI’s ChatGPT, Anthropic’s Claude and xAI’s Grok — to see how well they fared with eight fictional tax situations written as part of training materials by TaxSlayer, a tax-filing service.
They struggled, hard, miscalculating the refund or amount owed to the Internal Revenue Service by an average of more than $2,000. Even when provided with all the necessary materials, including all the forms they needed to fill out, the chatbots whiffed on some calculations.
“The problem with taxes is all those very small little details matter, and it’s not going to get every single little detail right,” said Benedict Evans, an analyst who writes a technology newsletter.
“These models get dramatically better over the course of every six months,” he added. “But they still give you what is roughly the right answer, and that’s not what you want.”
(The Times has sued OpenAI and its partner, Microsoft, claiming copyright infringement of news content related to A.I. systems. OpenAI and Microsoft have denied those claims.)
Related Content
Advertisement