Auditing Citations Before Submission: A Practical Checklist https://yila.ai

yilatrace3ff5 e0b23ba8bd Add research workflow guide 2 semanas atrás
README.md e0b23ba8bd Add research workflow guide 2 semanas atrás

README.md

Auditing Citations Before Submission: A Practical Checklist

Citation errors are surprisingly common in published work. Studies of citation accuracy across disciplines have repeatedly found that a meaningful share of references either contain bibliographic mistakes or, more seriously, do not support the statement they are attached to. Most of these errors are not dishonest. They come from copying references between documents, relying on memory, and citing papers that cite other papers. A citation audit before submission catches the majority of them. This article gives a practical, repeatable checklist you can run on a thesis chapter, a journal manuscript, a grant application or a client report.

Two kinds of citation error

It helps to separate errors into two families, because they are found in different ways.

Bibliographic errors are mistakes in the reference itself: wrong year, misspelled author name, incorrect volume or page range, broken DOI, or a preprint cited when a peer-reviewed version exists. These are annoying but usually harmless to the argument.

Quotation or substantive errors occur when the cited source does not say what the text claims. The source may report the opposite finding, a weaker finding, a finding in a different population, or nothing relevant at all. These errors damage credibility and can propagate through the literature when others copy them.

A good audit addresses both, but spends most of its effort on the second family.

Step 1: Freeze the reference list

Before auditing, export the full reference list from your reference manager and freeze it. Make sure every in-text citation corresponds to an entry, and every entry is cited at least once. Orphan references (listed but never cited) and ghost citations (cited but not listed) are the easiest errors to detect and the most embarrassing to leave in.

Step 2: Verify identifiers

For each reference, resolve its DOI or stable URL. Check that the title, authors and year that the identifier resolves to match your entry. While doing this, check whether the work has been retracted or has an expression of concern; retraction databases and publisher pages make this quick. Also check whether a cited preprint now has a published version, and decide which one you intend to cite.

Step 3: Build a claim-to-source map

This is the core of the audit. Go through the manuscript paragraph by paragraph and list every sentence that carries a citation. For each, record:

  • the sentence as written;
  • the cited source or sources;
  • the location in the source that supports it (page, table, figure, section).

If you kept traceable notes while reading, most of this map already exists. If not, this step is where the work happens, and it is worth doing anyway.

Step 4: Check support, not just presence

For each row in the map, open the source at the recorded location and ask four questions:

  1. Does the source make this claim? Not a related claim, the same claim.
  2. Is the strength preserved? "May be associated with" should not become "leads to".
  3. Is the scope preserved? A finding in adolescents should not be stated for adults; a finding from one country should not be generalised to all.
  4. Is this the original source? If the cited paper is itself citing someone else for this point, consider citing the original, after reading it.

Mark each row as "supported", "partially supported", "not supported" or "secondary". Fix every row that is not fully supported, either by rewording the sentence or by changing the citation.

Step 5: Look for unsupported claims

Citation audits naturally focus on sentences that have citations. Equally important are factual sentences that lack them. Skim the manuscript for numbers, comparisons, historical statements and descriptions of prior work that carry no reference. Either cite them, qualify them as your own interpretation, or remove them.

Step 6: Check quotations character by character

Direct quotations must match the source exactly, including punctuation and emphasis, with any changes signalled by brackets or ellipses. Paste the quote next to the source passage and compare. Also confirm the page number for each direct quote, since many style guides require it.

Step 7: Check self-consistency

Numbers that appear in more than one place (abstract, results, discussion, tables) should agree. Citations to the same source should use the same form throughout. If you cite a figure from a source in the introduction and the same figure again in the discussion, they should match.

How long does an audit take?

For a 6,000 to 8,000 word manuscript with sixty references, a careful first audit typically takes one to two working days. Subsequent audits are faster, because the claim-to-source map can be maintained as the manuscript evolves. If that sounds like a lot, compare it with the time cost of a major revision driven by a reviewer who spotted misrepresented sources, or a correction notice after publication.

Making audits cheaper with better tooling

The single most effective way to reduce audit time is to never lose the link between a sentence and its evidence in the first place. When notes, summaries and draft paragraphs are created inside a system that keeps source passages attached, the claim-to-source map is a by-product of writing rather than a separate task.

This is the design idea behind evidence-traceable research tools. For instance, Yila (https://yila.ai) is a research workbench where summaries, comparison tables and draft text stay connected to the passages they were built from, so checking whether a sentence is supported means opening the linked passage rather than searching the whole PDF. The same principle can be applied with a disciplined spreadsheet; the tool simply reduces the friction.

Auditing as a team

When several authors contribute to one manuscript, assign the audit by section rather than by reference. The person who wrote a section knows which sources they relied on, but a second reader is better at noticing when a sentence says more than its source. A simple rotation works well: each author audits a section written by someone else, records problems in the claim-to-source map, and the original author resolves them. This also spreads knowledge of the evidence base across the team, which helps when responding to reviewers later.

A printable checklist

Use this list at the end of each writing cycle:

  • Every in-text citation has a reference entry, and vice versa.
  • Every DOI or URL resolves to the correct work.
  • No cited work is retracted without acknowledgement.
  • Every cited claim has a recorded location in its source.
  • Every cited claim is fully supported in strength and scope.
  • Secondary citations are either traced to originals or labelled.
  • Uncited factual statements are cited, qualified or removed.
  • Direct quotations match the source exactly and include page numbers.
  • Repeated numbers and citations are consistent across sections.

Final thought

A citation is a promise to the reader: if you go here, you will find support for what I just said. Auditing citations is simply checking that you have kept every promise. Done routinely, it becomes a habit that makes your work more trustworthy and your peer review rounds noticeably shorter.