AAAI Conference on Artificial Intelligence (AAAI)
The Percentage of Empirical Papers Documenting Each Reproducibility Variable
| Venue | Year | Papers |
Repro. Score
Reproducibility Score based on Gundersen et al. (2025)
|
Doc. Mean
Global mean is the average score over the seven reproducibility variables for empirical research papers.
|
Doc. Median
Global median is the median score over the seven reproducibility variables for empirical research papers.
|
Dataset Doc.
Documentation mean is the average score over the Open Datasets and Dataset Splits reproducibility variables for empirical research papers.
|
Code Doc.
Documentation mean is the average score over the Open Source Code reproducibility variables for empirical research papers.
|
Other Doc.
Documentation mean is the average score over the Pseudocode, Hardware Specification, Software Dependencies, and Experiment Setup reproducibility variables for empirical research papers.
|
% Empirical
Percentage of papers that are empirical research vs theoretical research
|
% Industry
Percentage of empirical research papers with at least one author from Industry
|
Website |
|---|---|---|---|---|---|---|---|---|---|---|---|
| AAAI | 2025 | 2903 | 0.58 | 3.83 | 4.0 | 1.52 | 0.54 | 1.77 | 95.8% | 27.62% | |
| AAAI | 2024 | 2331 | 0.57 | 3.55 | 4.0 | 1.31 | 0.54 | 1.7 | 95.37% | 31.67% | |
| AAAI | 2023 | 1578 | 0.57 | 3.68 | 4.0 | 1.38 | 0.54 | 1.76 | 93.85% | 37.41% | |
| AAAI | 2022 | 1319 | 0.53 | 3.62 | 4.0 | 1.36 | 0.47 | 1.79 | 93.18% | 41.01% | |
| AAAI | 2021 | 1654 | 0.5 | 3.6 | 4.0 | 1.39 | 0.42 | 1.8 | 92.26% | 42.46% | |
| AAAI | 2020 | 1607 | 0.46 | 3.41 | 3.0 | 1.41 | 0.36 | 1.65 | 93.84% | 43.5% | |
| AAAI | 2019 | 1146 | 0.41 | 3.3 | 3.0 | 1.33 | 0.27 | 1.7 | 92.23% | 37.65% | |
| AAAI | 2018 | 935 | 0.37 | 3.24 | 3.0 | 1.32 | 0.21 | 1.71 | 92.51% | 28.09% | |
| AAAI | 2017 | 645 | 0.33 | 3.06 | 3.0 | 1.17 | 0.16 | 1.73 | 89.46% | 23.05% | |
| AAAI | 2016 | 676 | 0.27 | 2.65 | 3.0 | 1.01 | 0.12 | 1.53 | 88.02% | 22.35% | |
| AAAI | 2015 | 651 | 0.25 | 2.54 | 3.0 | 0.91 | 0.09 | 1.53 | 84.79% | 17.39% | |
| AAAI | 2014 | 447 | 0.24 | 2.57 | 3.0 | 0.88 | 0.08 | 1.61 | 87.25% | 16.41% |