A study published in medRxiv highlights the issue of AI hallucinations in foundation models used in medicine. These hallucinations, defined as instances where models generate misleading medical content, pose a significant risk to clinical decisions and patient safety. The study focused on understanding the characteristics, causes, and implications of these hallucinations, using a taxonomy, benchmarking models with a medical hallucination dataset, and analyzing physician-annotated responses to real medical cases. The research revealed that techniques like chain-of-thought and search augmented generation can reduce hallucination rates. However, despite these improvements, non-trivial levels of hallucinations persist. A multi-national clinician survey emphasized the need for robust detection and mitigation strategies, as well as clearer ethical and regulatory guidelines. In related news, Medicomp Systems’ CEO reported that 8% to 10% of AI-captured information from complex medical encounters may be correct, with their tool designed to flag these issues for review. Additionally, the American Cancer Society and Layer Health are collaborating to use LLMs to expedite cancer research, analyzing data from 300,000 participants in the Cancer Prevention Study-3.
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional
Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes.The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
