Journal of Artificial Intelligence Research (JAIR)
The Percentage of Empirical Papers Documenting Each Reproducibility Variable
| Venue | Year | Papers |
Repro. Score
Reproducibility Score based on Gundersen et al. (2025)
|
Doc. Mean
Global mean is the average score over the seven reproducibility variables for empirical research papers.
|
Doc. Median
Global median is the median score over the seven reproducibility variables for empirical research papers.
|
Dataset Doc.
Documentation mean is the average score over the Open Datasets and Dataset Splits reproducibility variables for empirical research papers.
|
Code Doc.
Documentation mean is the average score over the Open Source Code reproducibility variables for empirical research papers.
|
Other Doc.
Documentation mean is the average score over the Pseudocode, Hardware Specification, Software Dependencies, and Experiment Setup reproducibility variables for empirical research papers.
|
% Empirical
Percentage of papers that are empirical research vs theoretical research
|
% Industry
Percentage of empirical research papers with at least one author from Industry
|
Website |
|---|---|---|---|---|---|---|---|---|---|---|---|
| JAIR | 2025 | 132 | 0.51 | 3.89 | 4.0 | 1.19 | 0.56 | 2.14 | 72.73% | 14.58% | |
| JAIR | 2024 | 105 | 0.63 | 4.19 | 4.0 | 1.28 | 0.65 | 2.26 | 68.57% | 16.67% | |
| JAIR | 2023 | 100 | 0.51 | 4.11 | 4.0 | 1.2 | 0.59 | 2.33 | 61.0% | 19.67% | |
| JAIR | 2022 | 118 | 0.5 | 4.13 | 4.0 | 1.2 | 0.6 | 2.33 | 72.03% | 23.53% | |
| JAIR | 2021 | 104 | 0.53 | 3.79 | 4.0 | 1.17 | 0.56 | 2.06 | 63.46% | 25.76% | |
| JAIR | 2020 | 84 | 0.48 | 3.83 | 4.0 | 1.17 | 0.5 | 2.17 | 71.43% | 16.67% | |
| JAIR | 2019 | 75 | 0.41 | 3.71 | 4.0 | 1.02 | 0.43 | 2.27 | 65.33% | 22.45% | |
| JAIR | 2018 | 69 | 0.37 | 3.61 | 4.0 | 1.05 | 0.3 | 2.27 | 63.77% | 27.27% | |
| JAIR | 2017 | 68 | 0.41 | 3.96 | 4.0 | 0.89 | 0.44 | 2.62 | 66.18% | 11.11% | |
| JAIR | 2016 | 65 | 0.44 | 3.94 | 4.0 | 1.38 | 0.33 | 2.23 | 80.0% | 19.23% | |
| JAIR | 2015 | 48 | 0.39 | 4.18 | 4.0 | 1.18 | 0.33 | 2.67 | 68.75% | 21.21% | |
| JAIR | 2014 | 68 | 0.35 | 3.77 | 4.0 | 1.06 | 0.28 | 2.43 | 69.12% | 4.26% |