AI-Fabricated Citations In Over 2,800 Biomedical Journal Articles

Source Domain: www.forbes.com

Here’s a summary of the key points regarding the use of AI in scientific papers:

Fabricated References: The Lancet correspondence indicates that over a three-year period, 4,046 references in 2,810 published scientific articles were completely fabricated, likely due to AI hallucinations.
AI Verification System: A research team from Columbia University and the University of Eastern Finland developed an AI verification system to identify potentially fabricated references, which found over 4,000 fabricated references as of early 2026.
Increasing Incidence: The rate of papers with fabricated references increased from one per 2,828 papers in 2023, to one per 458 in 2025, and to one per 277 by early 2026.
Excessive Fabrication: In 2025, a particularly egregious case was found, where one paper had 60% of its citations fabricated, amounting to 18 out of 30 references.
Paper Mills: The study identified “paper mills” as contributors to the fabricated references, with some authors linked to multiple papers in a single journal containing fabrications.
Correlation with AI Use: The rise in fabricated citations correlates with increased reliance on large language models (LLMs) by researchers for generating their papers, raising concerns about AI-induced hallucinations.
Future Concerns: The problem of fabricated citations is expected to worsen with more researchers using AI-generated content and the proliferation of unestablished for-profit scientific journals lacking quality control.
Potential AI Solutions: Developing AI tools to detect inaccuracies, particularly in AI-generated works, may help mitigate the issue, but the adoption and effectiveness of such tools by scientific publishers remain uncertain.