{"id":223547,"date":"2026-06-01T08:25:00","date_gmt":"2026-06-01T12:25:00","guid":{"rendered":"https:\/\/testing.news-you-need.com\/index.php\/2026\/06\/01\/ai-chatbots-fail-medical-misinformation-test-returning-inaccurate-and-fabricated-advice\/"},"modified":"2026-06-01T09:30:32","modified_gmt":"2026-06-01T13:30:32","slug":"ai-chatbots-fail-medical-misinformation-test-returning-inaccurate-and-fabricated-advice","status":"publish","type":"post","link":"https:\/\/testing.news-you-need.com\/index.php\/2026\/06\/01\/ai-chatbots-fail-medical-misinformation-test-returning-inaccurate-and-fabricated-advice\/","title":{"rendered":"AI chatbots fail medical misinformation test, returning inaccurate and fabricated advice"},"content":{"rendered":"<p><a href=\"https:\/\/www.psypost.org\/ai-chatbots-fail-medical-misinformation-test-returning-inaccurate-and-fabricated-advice\/\">AI chatbots fail medical misinformation test, returning inaccurate and fabricated advice<\/a><\/p>\n<p><a href=\"https:\/\/www.psypost.org\/ai-chatbots-fail-medical-misinformation-test-returning-inaccurate-and-fabricated-advice\/\">https:\/\/www.psypost.org\/ai-chatbots-fail-medical-misinformation-test-returning-inaccurate-and-fabricated-advice\/<\/a><\/p>\n<p>Publish Date: <a href=\"publish_date]\">2026-06-01 08:25:00<\/a><\/p>\n<p>Source Domain: <a href=\"www.psypost.org\">www.psypost.org<\/a><\/p>\n<ul>\n<li><strong>Study Findings<\/strong>: An audit of chatbot responses in health and medical fields prone to misinformation found that 49.6% of responses from various chatbots were problematic, with 30% deemed somewhat problematic and 19.6% highly problematic.<\/li>\n<li><strong>Research Scope<\/strong>: The audit involved assessing five chatbots across five distinct fields prone to misinformation, namely cancer, vaccines, stem cells, nutrition, and athletic performance.<\/li>\n<li><strong>Chatbot Performance<\/strong>: Chatbot performance varied significantly across the study fields, with better responses in vaccines and cancer compared to nutrition, athletic performance, and stem cells.<\/li>\n<li><strong>Confidence and Readability<\/strong>: Chatbot outputs were expressed with high confidence and complexity, corresponding to a college level reading difficulty, which may not be accessible to the general public.<\/li>\n<li><strong>Citation Accuracy<\/strong>: The chatbots demonstrated poor reference quality, often hallucinating \u2013 producing incorrect or unsupported statements that sound plausible.<\/li>\n<li><strong>Study Conclusion<\/strong>: The study concluded that continued deployment of these chatbots without public oversight risks spreading misinformation. <\/li>\n<li><strong>Experts&#8217; Involvement<\/strong>: The paper was authored by a team of researchers including Nicholas B. Tiller, Alessandro R. Marcon, Marco Zenone, Kristin E. Kidd, Asker E. Jeukendrup, Zubin Master, and Timothy Caulfield.<\/li>\n<li><strong>Ongoing Development<\/strong>: The research contributes to understanding chatbots&#8217; current states, noting that continual development may produce different findings in future studies.<\/li>\n<\/ul>\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>AI chatbots fail medical misinformation test, returning inaccurate and fabricated advice https:\/\/www.psypost.org\/ai-chatbots-fail-medical-misinformation-test-returning-inaccurate-and-fabricated-advice\/ Publish Date: 2026-06-01&#8230;<\/p>\n","protected":false},"author":1,"featured_media":223548,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/www.psypost.org\/wp-content\/uploads\/2026\/04\/artificial-intelligence-ai-chip.jpg","fifu_image_alt":"","footnotes":""},"categories":[14],"tags":[],"class_list":["post-223547","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence"],"_links":{"self":[{"href":"https:\/\/testing.news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/223547"}],"collection":[{"href":"https:\/\/testing.news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/testing.news-you-need.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/testing.news-you-need.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/testing.news-you-need.com\/index.php\/wp-json\/wp\/v2\/comments?post=223547"}],"version-history":[{"count":1,"href":"https:\/\/testing.news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/223547\/revisions"}],"predecessor-version":[{"id":223549,"href":"https:\/\/testing.news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/223547\/revisions\/223549"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/testing.news-you-need.com\/index.php\/wp-json\/wp\/v2\/media\/223548"}],"wp:attachment":[{"href":"https:\/\/testing.news-you-need.com\/index.php\/wp-json\/wp\/v2\/media?parent=223547"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/testing.news-you-need.com\/index.php\/wp-json\/wp\/v2\/categories?post=223547"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/testing.news-you-need.com\/index.php\/wp-json\/wp\/v2\/tags?post=223547"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}