Reproducibility: Evaluating the Evaluations
1 : Lehigh University [Bethlehem]
-
Website
27 Memorial Drive West, Bethlehem, PA 18015 -
United States
2 : Department of Electrical, Computer, & Systems Engineering
(ECSE)
* : Corresponding author
Rensselaer Polytechnic Institute - Troy, New York 12180-3590 -
United States
Evaluation is at the heart of reproducibility in research, and the related concept of replicability. In this paper, we survey approaches to evaluating reproducibility and replicability, taking note of some substantial failings in current practice. We make recommendations to be considered and discussed by the research community as we all work together to advance the desirable goals of conducting and publishing research that achieves higher degrees of reproducibility.