Evidence literacy · VIP10 reference batch 05
Repeatability Is Not the Same as Reproducibility
Yes — repeating a measurement under new conditions can change what the numbers mean. Repeatability, intermediate precision, and reproducibility are related but distinct concepts that describe how much you can trust a single laboratory result when conditions vary. In brief: repeatability measures variation when nothing important changes, intermediate precisio
Overview
Yes — repeating a measurement under new conditions can change what the numbers mean. Repeatability, intermediate precision, and reproducibility are related but distinct concepts that describe how much you can trust a single laboratory result when conditions vary. In brief: repeatability measures variation when nothing important changes, intermediate precision adds routine variations inside one lab, and reproducibility captures variation when the test is moved outside the original setting. Knowing which applies is essential for interpreting the limits of any single result and for deciding what further evidence is needed.
Why these distinctions matter A laboratory value is not an absolute truth; it is an observation produced by a method in a context. The context includes the instrument, operator, day, reagent batch, and laboratory environment. When any of those factors change, the expected variation in results also changes. Understanding the appropriate category of variability tells you how broadly a single result can be generalized — for example, whether it is reasonable to compare it to another lab’s result, or whether observed differences likely reflect real change versus methodological variation .
Key concepts and what they mean for one result
How to read evidence about method precision When you encounter a reported precision statement or uncertainty range, check which level it refers to. Authors and method documents sometimes use “precision” loosely; the practical meaning changes with scope.
A concise table to clarify evidence types
| Evidence type | Typical study source | What it bounds for a single result | |---------------|----------------------|-----------------------------------| | Repeatability | Same-run replicates in one lab | Minimum measurement noise in that run | | Intermediate precision | Multiple runs/days/operators in one lab | Expected variation for same lab over time | | Reproducibility | Interlaboratory studies | Expected variation across different labs |
What remains unresolved without further evidence Precision characterizes variability; it does not establish suitability or fitness-for-purpose for every sample matrix or application. For example, a method’s reproducibility across a set of participating labs does not automatically imply it will perform the same on a different matrix, a different instrument platform, or in a laboratory with different training and quality systems. Also, precision statements do not certify regulatory compliance, clinical suitability, or safety. Those assessments require separate, current primary evidence such as validation reports, accreditation documentation, or matrix-specific studies .
Practical steps for readers who must interpret a single lab result
Remember the caveat Describing these precision categories clarifies the evidentiary scope around a laboratory result. This explanation of method-level precision is meant to help you read evidence and judge uncertainty. It does not substitute for, nor imply, method accreditation, full validation for every matrix, or any clinical or regulatory conclusion without separate, current primary evidence .
- Repeatability (within-run variation)
- What it is: Repeatability is the variation you expect when the same operator uses the same equipment, reagents and procedures, in the same laboratory, over a short timescale. Typically this is quantified by repeated measurements of the same sample under these tightly controlled conditions .
- What it tells you about one result: If a method has good repeatability, multiple aliquots measured back-to-back in the same run will cluster tightly. That limits the uncertainty attributable to the act of measurement itself in that narrow context. However, repeatability does not account for routine differences that occur between days, instruments, or operators; therefore a single result with good repeatability is not necessarily representative across those broader conditions.
- Intermediate precision (within-laboratory, between-run variation)
- What it is: Intermediate precision expands the scope to include normal variations that occur within one laboratory over time — different days, different operators, perhaps different calibrations or reagent lots — but still within the same laboratory and standard operating environment .
- What it tells you about one result: Intermediate precision gives a more realistic picture of how much a single laboratory result might vary if the same lab repeated the measurement on another day or with another trained analyst. If intermediate precision is substantially worse than repeatability, it indicates that day-to-day or operator-related factors contribute meaningfully to uncertainty. A single result should therefore be interpreted against the intermediate-precision uncertainty when assessing consistency with prior measurements from the same lab.
- Reproducibility (between-laboratory variation)
- What it is: Reproducibility is the variation observed when the same method is performed in different laboratories — different instruments, different operators, different environments, and potentially different interpretations of protocol details. Reproducibility is typically assessed through interlaboratory studies or proficiency testing .
- What it tells you about one result: Reproducibility defines the limits of how comparable a result is across laboratories. If reproducibility is poor relative to repeatability, then differences between labs could be as large as the differences you are trying to detect biologically or chemically. A single lab’s result should not be assumed to apply universally without evidence about reproducibility.
- Look for the described study design: repeatability data come from same-run replicates; intermediate precision data come from repeated runs across days/operators; reproducibility data come from interlaboratory comparisons .
- Compare magnitudes: small within-run variance and larger between-lab variance are common. That pattern tells you that operational differences, not measurement noise alone, drive much of the uncertainty.
- Assess applicability: consider whether the samples, matrices, instruments, and operator training in the cited study match the situation you care about. If they differ, the quoted precision may not translate directly.
- Ask which precision metric is being used to frame uncertainty. Do not assume “precision” equals interlaboratory agreement.
- If you need comparability between labs, demand reproducibility data from interlaboratory studies or proficiency testing relevant to the matrix and equipment in question.
- If you only need to know whether a change occurred within the same lab, intermediate precision is the appropriate reference.
- If possible, corroborate surprising or consequential single results with additional measurements designed to address the relevant precision scope (e.g., replicate within-run for repeatability, repeat on a different day for intermediate precision, or an independent lab for reproducibility).
