reproducibilityindex.ai

Conference on Neural Information Processing Systems (NeurIPS)

Venue URL:

The Percentage of Empirical Papers Documenting Each Reproducibility Variable

Venue Year Papers
Repro. Score Reproducibility Score based on Gundersen et al. (2025)
Doc. Mean Global mean is the average score over the seven reproducibility variables for empirical research papers.
Doc. Median Global median is the median score over the seven reproducibility variables for empirical research papers.
Dataset Doc. Documentation mean is the average score over the Open Datasets and Dataset Splits reproducibility variables for empirical research papers.
Code Doc. Documentation mean is the average score over the Open Source Code reproducibility variables for empirical research papers.
Other Doc. Documentation mean is the average score over the Pseudocode, Hardware Specification, Software Dependencies, and Experiment Setup reproducibility variables for empirical research papers.
% Empirical Percentage of papers that are empirical research vs theoretical research
% Industry Percentage of empirical research papers with at least one author from Industry
Website
NeurIPS 2024 4035 0.69 4.65 5.0 1.36 0.8 2.49 93.63% 39.25%
NeurIPS 2023 3218 0.6 4.05 4.0 1.28 0.65 2.12 92.42% 40.99%
NeurIPS 2022 2671 0.64 3.94 4.0 1.28 0.77 1.9 90.94% 43.85%
NeurIPS 2021 2334 0.58 3.66 4.0 1.24 0.63 1.79 90.66% 46.22%
NeurIPS 2020 1898 0.56 3.38 3.0 1.2 0.58 1.6 89.88% 43.26%
NeurIPS 2019 1428 0.52 3.31 3.0 1.16 0.53 1.63 89.64% 43.05%
NeurIPS 2018 1009 0.45 3.13 3.0 1.14 0.39 1.59 90.19% 40.99%
NeurIPS 2017 679 0.39 2.95 3.0 1.12 0.29 1.54 90.13% 35.62%
NeurIPS 2016 569 0.35 2.88 3.0 1.09 0.24 1.56 86.99% 29.09%
NeurIPS 2015 403 0.35 2.94 3.0 1.04 0.25 1.65 88.34% 25.0%
NeurIPS 2014 411 0.3 2.78 3.0 1.03 0.17 1.58 89.54% 22.83%