ChatGPT is a serial fantasist
noisediver.orgChatGPT invents tools and organisations that do not exist while answering domain-specific questions
There was an example I liked where somebody asked it a scientific question and it wrote an answer that looked superficially OK and wrote citations that looked like real citations except when somebody tried to look them up.
ChatGPT has no conception of "truth" and when I see people who are excited about the junk that it spews I think it makes those people look really bad because it seems like those people have trouble telling fact from fiction.