Reproducibility Score Trend

Edition reproducibility score by venue over time.

Global Documentation Mean Trend

Edition reproducibility metrics global mean by venue over time.

Latest Editions

Browse reproducibility metrics across the latest editions of each venue.

Reproducibility Score based on Gundersen et al. (2025)
Global mean is the average score over the seven reproducibility variables for empirical research papers.
Global median is the median score over the seven reproducibility variables for empirical research papers.
Documentation mean is the average score over the Open Datasets and Dataset Splits reproducibility variables for empirical research papers.
Documentation mean is the average score over the Open Source Code reproducibility variables for empirical research papers.
Documentation mean is the average score over the Pseudocode, Hardware Specification, Software Dependencies, and Experiment Setup reproducibility variables for empirical research papers.
Percentage of papers that are empirical research vs theoretical research
Percentage of empirical research papers with at least one author from Industry
Website
AAAI 2025 2903 0.58 3.83 4.0 1.52 0.54 1.77 95.8% 27.62%
DMLR 2025 13 0.76 4.55 5.0 1.82 0.82 1.91 84.62% 18.18%
ICLR 2025 3700 0.66 4.54 5.0 1.59 0.69 2.26 97.97% 42.65%
ICML 2025 3330 0.61 4.42 5.0 1.52 0.64 2.26 94.95% 36.69%
IJCAI 2025 1015 0.56 3.82 4.0 1.46 0.51 1.85 92.32% 17.18%
JAIR 2025 132 0.51 3.89 4.0 1.19 0.56 2.14 72.73% 14.58%
JMLR 2025 269 0.46 3.79 4.0 1.16 0.57 2.06 86.99% 17.52%
NeurIPS 2024 4035 0.69 4.65 5.0 1.36 0.8 2.49 93.63% 39.25%
TMLR 2025 1418 0.62 4.51 5.0 1.62 0.62 2.26 94.71% 33.8%