When is a result likely to be replicable?
When researchers investigate the same scientific question using the same methods and similar tools, the results are not likely to be identical—unlike in computational reproducibility in which bitwise agreement between two results can be expected (see Chapter 4 ).
Which is true of the judgment of replication?
A judgment that “Result A is replicated by Result B” must be identical to the judgment that “Result B is replicated by Result A.” There must be a symmetry in the judgment of replication; otherwise, internal contradictions are inevitable.
Why is replicability important in science and engineering?
Beginning with an examination of methods to assess replicability, in this chapter we discuss evidence that bears on the extent of non-replicability in scientific and engineering research and examine factors that affect replicability. Replication is one of the key ways scientists build confidence in the scientific merit of results.
Which is the best paper on replicability in science?
Washington, DC: The National Academies Press. doi: 10.17226/25303. Replicability is a subtle and nuanced topic, especially when discussed broadly across scientific and engineering research.
How are different scientific disciplines differ in replicability?
As noted in Chapter 2, different scientific disciplines are distinguished in part by the types of tools, methods, and techniques used to answer questions specific to the discipline, and these differences include how replicability is assessed. 1 See, for example, the cancer biology project in Table 5-1 in this chapter.
What is the relationship between replication and validity?
Because of the complicated relationship between replicability and its variety of sources, the validity of scientific results should be considered in the context of an entire body of evidence, rather than an individual study or an individual replication.