AI hallucinations - Check you med records for accuracy

[begreen]

A common AI tool used in medicine and law transcriptions can add or distort things that weren't said. This could have serious implications in a hospital or court setting.

Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said

Whisper is a popular transcription tool powered by artificial intelligence, but it has a major flaw. It makes things up that were never said.

apnews.com

 

[ABMax24]

AI can definitely hallucinate. I've used it for review of documents and on one occasion had ChatGPT make up very specific technical requirements that were not in the document being reviewed. I re-phrased the question about 6 different ways and every time got a continuation of the hallucinated requirement, each time adding more detail. The responses were very concise and specific, and would have been completely legitimate if that requirement actually existed in the document.

It's a work in progress, it does have it's uses, unfortunately though, it's not yet the revolutionary tool it is claimed to be.

 

[begreen]

Unfortunately the sales pitch for AI is strong and tons of businesses are adopting AI solutions to reduce labor costs. There are going to be a lot of mistakes happening as these untested systems gain agency.