Source checklist

Plain-language answer #

Step 3 of how to evaluate a coincidence claim — “verify the facts” — is the step that most viral coincidence stories never survive, once it’s actually applied. This checklist gives a concrete way to do that verification, mirroring the source hierarchy this site itself uses for its own citations: some sources are simply more trustworthy than others, and knowing where a claim’s evidence sits on that hierarchy changes how much weight it deserves.

The checklist #

For each fact load-bearing to a coincidence claim, ask:

1. What is the original source, exactly? A retelling, a screenshot of a retelling, and the actual primary record (a letter, a contemporary news report, an official document) are three different levels of reliability, even when they describe the “same” fact.
2. How many retellings sit between the original source and the version you’re reading? Details reliably drift, sharpen, and get exaggerated with each retelling — a claim that has circulated widely online has had many opportunities to accumulate embellishment before reaching you.
3. Does the source have a stake in the story being dramatic? A source whose interest is in an engaging story (rather than an accurate one) is not automatically wrong, but deserves more independent corroboration before a specific number or quote is treated as solid.
4. Can you find independent corroboration? Two or more sources that trace back to the same original account are not independent corroboration — check whether a second, separately sourced account confirms the same detail.
5. Are there any corrections, retractions, or documented disputes? A claim that looked solid on first publication can later be revised or retracted; checking for this is part of verifying the fact, not an optional extra step.
6. What kind of source is it, on the hierarchy below? Higher tiers deserve more weight by default, though a lower-tier source with strong independent corroboration can outweigh an uncorroborated higher-tier one.

A rough source hierarchy #

1. Primary records and peer-reviewed studies.
2. Systematic reviews, meta-analyses, and scholarly handbooks.
3. University-press books and standard textbooks.
4. Reputable science organizations and expert explanatory material.
5. High-quality journalism.
6. Popular books, blogs, forwarded messages, and social media posts — useful as leads to chase down, not as a resting place for a load-bearing fact.

Even careful, professionally edited research is not immune to holding up poorly under later scrutiny — a documented, empirical concern in its own right, not just a hypothetical caution.(Ioannidis, 2005) That is a reason to apply this checklist rigorously even to higher-tier sources, not a reason to give up on tiering sources at all.

Common misconception #

“It’s been shared thousands of times, so someone must have checked it” gets the direction of evidence backwards. Wide circulation is evidence that a claim is engaging, not that it is accurate — the two properties are only loosely related, and a story’s shareability often comes precisely from the same dramatic details that verification is most likely to correct or remove.

Limits and open questions #

Full verification is not always possible — some facts genuinely cannot be traced back further than a retelling, especially for older or informally documented events. When that’s the case, the honest response is to say so plainly (“this detail could not be traced to a primary source”) rather than either omitting the caveat or discarding an otherwise well-supported claim because one minor detail resists verification.

Related #

• How to evaluate a coincidence claim — this checklist expands step 3 of the full twelve-step method.
• Anecdotes and data covers why even a fully verified single anecdote still can’t answer a question about general frequency.

Key takeaways #

• Trace a load-bearing fact back toward its original source, and note how many retellings sit in between.
• Wide circulation of a claim is evidence of how shareable it is, not of how accurate it is.
• Apply source-tiering rigorously even to higher-tier sources — published, peer-reviewed claims can and do fail to hold up on closer scrutiny.