Check AI Citations and Retracted Papers

Website image

Ryan McCarroll

2 min read

Check AI Citations and Retracted Papers

Check whether each reference identifies a real work, compare its bibliographic details with the source record, then read the paper and any publisher notices to check its relevance and retraction status. A working DOI does not prove that a paper supports your claim, and a failed database match does not prove fabrication. The AnswerThis Reference Checker helps screen a reference list for publication matches, metadata differences, and recorded retractions so you can investigate flagged entries against the original sources.

TL;DR

  • Verify reference identity, bibliographic metadata, and source content separately.

  • Not found means no confident match, not proof of fabrication.

  • Read retraction notices and check that they concern the original paper.

  • The first 20 completed checks are free per browser, shared between both checkers.

How to check a reference in three steps

Identity, metadata, and content are three different checks. Complete all three before relying on an AI-suggested citation, even if its title and journal look plausible.

1. Verify the DOI or publication identity

Resolve the DOI and confirm that it leads to the intended publication. Compare the destination title with your reference, and remove trailing punctuation if the link fails. If the work has no DOI, search its exact title and author in a bibliographic database, publisher site, or library catalogue. A missing DOI or broken link alone is not proof that the work was fabricated.

Use the original publication’s identifier rather than asking a chatbot to repair an uncertain reference. For a book chapter, identify both the chapter and the containing book. For a report or other grey literature, check the issuing organisation and document version.

2. Compare the bibliographic metadata

Compare the authors, title, journal or publisher, year, volume and page range or article number with the original record. A reference can identify a real paper while containing incorrect details. Check each disputed field before editing, and preserve accurate information that a database summary omits.

Separate a substantive mismatch from citation-style formatting. Different capitalisation or a journal abbreviation is not the same problem as a DOI pointing to another paper. Online-first and issue dates can also require checking the original publication rather than assuming one database date is the only relevant year.

3. Read the content and check notices

Read the source to confirm it supports the claim you intend to make. Check the publisher page and available retraction metadata for notices linked to that exact work. Read any correction, expression of concern, or retraction notice, and record the source identifier, notice, and your review decision before submission.

A matching reference establishes identity, not scientific reliability. Keep the quoted passage or relevant section alongside your interpretation so a co-author can check the connection between the source and your sentence.

Warning signs of an AI-fabricated citation

An identity conflict is a reason to investigate, not a reason to accuse. A fake citation checker cannot establish whether a person or an AI wrote a reference. It can expose inconsistencies that help you locate or rule out a particular work.

DOI fails to resolve

  • Verification step: Remove extra punctuation and search the exact identifier

  • Possible explanation: Typo, malformed identifier, or an invented DOI

DOI opens a different paper

  • Verification step: Compare the destination title and authors

  • Possible explanation: Wrong identifier attached to a real or invented reference

Title has no confident match

  • Verification step: Search exact title plus author, then the publisher or catalogue

  • Possible explanation: Altered title, limited coverage, or a non-existent work

Journal, year, and volume conflict

  • Verification step: Inspect the publisher record

  • Possible explanation: Incorrect metadata rather than a fabricated paper

Authors do not match the identified work

  • Verification step: Compare the full author list

  • Possible explanation: Mixed records or incorrect attribution

A notice appears

  • Verification step: Check the notice’s target DOI

  • Possible explanation: Retraction, correction, or a notice for a different work

Do not treat polished formatting as evidence. A reference can combine a real journal, plausible authors, and an invented title. Conversely, an awkwardly formatted reference can identify a genuine publication.

If no match remains after checking authoritative sources, record what you searched and ask the reference’s contributor for the source. Do not replace it with a merely similar paper without checking whether that paper supports the claim.

AI fabricated citations


How often AI fabricates references: the evidence

Published studies document hallucinated citations, but their percentages apply to the tested models, prompts, and samples. They do not establish a single fabrication rate for every chatbot or for current systems in 2026.

Walters and Wilder, Scientific Reports, 2023

  • Sample or scope: 636 references in 84 generated literature reviews on 42 topics

  • Reported finding: 55% of GPT-3.5 references and 18% of GPT-4 references were fabricated. 43% of GPT-3.5 and 24% of GPT-4 real references had substantive errors

Bhattacharyya et al., 2023

  • Sample or scope: 115 references from 30 generated medical articles

  • Reported finding: 47% fabricated and 46% authentic but inaccurate, as shares of all references

Hsiao and Schneider, 2021

  • Sample or scope: 13,252 post-retraction biomedical citation contexts

  • Reported finding: 722 contexts, or 5.4%, acknowledged the retraction

Retraction Watch, 26 September 2026

  • Sample or scope: Cumulative database size reported on that date

  • Reported finding: More than 67,000 retractions, not an annual total

The first three examples concern fabricated references or bibliographic errors. The last one concerns retraction awareness and database coverage, not AI fabrication rates. Do not combine these measures into one percentage.

A useful distinction from Walters and Wilder is that a real paper with wrong metadata differs from a reference to a work that does not exist. Your correction process should preserve that distinction. Every AI-suggested reference still needs source verification, including references produced by a system that can retrieve papers.

Retracted papers: how to check and what to do

A retraction is a formal publisher notice withdrawing an article from ordinary reliance. Reasons can include serious errors, fabrication or falsification, plagiarism, duplicate publication, or ethical problems. Read the notice for the actual reason and scope rather than assuming misconduct in every case. The original article often remains online with a linked notice.

Check the original DOI and publisher record

Identify the original work, inspect its publisher page, and follow any associated notices. Then search the DOI or full title in recorded retraction evidence. Crossref acquired the Retraction Watch database in September 2023 and distributes it openly. Crossref’s documentation says Retraction Watch updates the database every working day.

The Retraction Checker for DOIs and titles uses Crossref retraction evidence, including Retraction Watch and publisher updates when available. Crossref, the AnswerThis search index, and PubMed supply publication-matching evidence. A match to a title is not enough when several works share similar titles: use the original DOI before assigning a notice to a paper.

A practical metadata example

Enter the DOI 10.1016/S0140-6736(97)11096-0 into the AnswerThis Retraction Checker. The checker identifies the paper “Ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children” and flags it as Retracted, with a link to the corresponding retraction record.

This is a documented example used to demonstrate the checker. It shows why checking publication status matters: a reference can be genuine and traceable to a real publication while also having a subsequent retraction notice. PubMed likewise marks this article as retracted.

AnswerThis Retraction Checker Result


Interpret the notice before deciding what to cite

Confirm that the notice targets your original paper. A retraction notice is a separate publication, and a correction or expression of concern is not automatically a retraction. Record the original DOI, notice identifier when available, review date, and decision.

Do not rely on withdrawn findings as ordinary supporting evidence. A retracted work can still be discussed as an example of problematic science or as an object of analysis, provided its status is explicit. Revisit any sentence that depended on it, and find appropriate replacement evidence rather than simply deleting the bibliography entry.

Do retracted papers still get cited?

Yes. Hsiao and Schneider found that only 5.4% of the 13,252 post-retraction citation contexts in their biomedical sample acknowledged retraction. The unit was a citation context, not every citation across all disciplines. That distinction keeps the finding accurate while showing why inherited reference lists also need checking.

“No recorded retraction” means none was found in the available checked evidence. It is not proof of complete coverage, an assessment of validity or a guarantee that publisher updates have reached every service. Recheck important references before submission and retain uncertainty when a provider is unavailable.

What the checker labels mean

AnswerThis Reference Checker accepts DOIs, titles and complete references. Its current page lists Crossref, OpenAlex and PubMed as bibliographic providers. The Retraction Checker uses Crossref, the AnswerThis search index and PubMed for publication matching, with Crossref records supplying the retraction updates inspected. These are metadata comparisons, not automated scientific peer review.

Found

  • Meaning: A publication matches the fields actually checked

  • Next action: Read the paper and assess support for your claim

Not found

  • Meaning: No confident publication match was obtained

  • Next action: Check typos, DOI and publisher or catalog coverage

Details differ

  • Meaning: Supplied fields disagree with the matched metadata

  • Next action: Review the particular differences against the original

Retracted

  • Meaning: A recorded retraction concerns the matched work

  • Next action: Follow the notice and document your decision

Ambiguous match

  • Meaning: More than one plausible work remains

  • Next action: Supply the original DOI

Check unavailable

  • Meaning: Evidence could not be obtained, or a provider failed

  • Next action: Retry or consult the publisher, retaining uncertainty

The interface may display Details differ as “Details do not match.” Found does not prove every author initial or page range was checked. Neither Found nor an absent retraction record establishes that a study’s methods are sound.

The first 20 completed checks are free per browser, shared between the Reference Checker and Retraction Checker. Copy your results before continuing into AnswerThis because your paper and reference list do not transfer automatically.

After using the retraction checker, keep one audit row for each reference checked: original reference, matched DOI or record, checker result, identified issue or retraction notice, manual verification, and final decision. Preserve the original entry until you have verified any proposed correction. Do not silently accept an ambiguous title match or delete every Not found entry.

FAQs

How do I check whether a reference is real?

Resolve its DOI and match the authors, title, journal, year, and pages with the original or bibliographic record. If there is no DOI, use the publisher or catalogue. Read the source and relevant notices before relying on it.

How often do AI chatbots fabricate citations?

There is no universal rate. Walters and Wilder’s 2023 study found 55% of GPT-3.5 references and 18% of GPT-4 references fabricated. Bhattacharyya and colleagues’ 2023 sample found 47% fabricated and 46% authentic but inaccurate. These results do not establish current-model rates.

How do I check if a paper has been retracted?

Check its publisher page and search the original DOI or full title in retraction evidence. Read any notice and confirm it targets that exact work. An unavailable check or absent record does not prove no retraction exists.

Does not found mean a reference was fabricated?

It means no confident database match was obtained. Typos, missing DOIs, recent publications, and sources outside database coverage can cause it. Check the publisher or catalogue before concluding the work does not exist.

How does AnswerThis help check citations and retractions?

AnswerThis helps screen references for publication matches, metadata differences, and recorded retractions. Review flagged entries against the source and publisher notices. A matching record does not verify the paper’s claims, and no recorded retraction does not guarantee validity or complete coverage.

To find papers and write with traceable sources after reviewing your reference list, Explore AnswerThis. Keep your checker results and verify the evidence behind each claim before submission.