Statistics reveal that AI chatbots often struggle with accuracy in retrieving correct articles. In a comprehensive study, it was found that these chatbots provided incorrect answers to over 60% of the queries posed to them. The performance varied across different platforms. Perplexity, for instance, answered 37% of the queries incorrectly, whereas Grok 3 had a significantly higher error rate, with 94% of its responses being incorrect. These numbers highlight a critical area for improvement in AI technology. As AI chatbots continue to evolve, understanding their limitations and developing skills to discern accurate information will be essential for users.
owen cyclops
@owenbroadcast
·
Feb 13 a friend was discussing IQ tests with me and showed me this example of a difficult test question. we couldn’t find the answer, so i asked AI. interestingly, once we found it, we both got it correct (subtle flex, sorry) and AI got it wrong, complete with a full wrong explanation:
Frank Strong
@Frank_Strong
·
Mar 11 Generative AI is providing a lot of wrong answers with confidence.
“Collectively, they provided incorrect answers to more than 60 percent of queries.”
https://seroundtable.com/ai-search-engines-wrong-39038.html…
Great catch by
@rustybrick
˶˃ ᵕ ˂ NewsCat NO DMs˶ ˃ ᵕ ˂
@typocatCAv2
·
19h Using AI as your primary source to back up your post comments?
It’s wrong 60% of the time.
CHART OF THE DAY
Major AI search engines provided incorrect answers to more than 60 percent of queries. (Source: Columbia Journalism Review)
Pat,
@Goofball10x
·
22h ChatGPT (left image) gets this wrong, gives the intuitive but incorrect answer compared the the right
Timothy Caulfield
@CaulfieldTim
·
Mar 11 AI Search Has A Citation Problem https://cjr.org/tow_center/we-compared-eight-ai-search-engines-theyre-all-bad-at-citing-news.php…
“Premium chatbots provided more confidently incorrect answers than their free counterparts.”
“Overall, the chatbots often failed to retrieve the correct articles. Collectively, they provided incorrect answers to more
Ross Goldberg
@rossgoldberg
·
Mar 15 I spent hours fighting ChatGPT so you no longer have to. I discovered what to do to solve wonky responses and it’s simple: swap out your verbs. Your directions are getting lost in translation.
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional
Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes.The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
