Contract-based Design and Verification of Multi-Agent Systems with Quantitative Temporal Requirements

Authors: Rafael Dewes, Rayna Dimitrova

AAAI 2025 | Venue PDF | Archive PDF | Plain Text | LLM Run Details

Reproducibility Variable Result LLM Response
Research Type Experimental To evaluate our framework, we implemented the proposed compositional verification procedure in a prototype in Python using the Spot automata library (Duret-Lutz et al. 2022). We ran experiments on 6 MASs each with a number of agents between 3 and 6. The results, obtained on a consumer laptop with 16 GB of memory, are shown in Table 1.
Researcher Affiliation Academia CISPA Helmholtz Center for Information Security EMAIL
Pseudocode No The paper describes methods and definitions but does not contain any structured pseudocode or algorithm blocks.
Open Source Code No The paper states: "We implemented the proposed compositional verification procedure in a prototype in Python using the Spot automata library (Duret-Lutz et al. 2022)." and "Benchmarks are provided in (Dewes and Dimitrova 2024)." However, it does not explicitly state that the authors' implementation code is open-source or provide a direct link to a code repository.
Open Datasets No The paper mentions running experiments on "6 MASs" and that "Benchmarks are provided in (Dewes and Dimitrova 2024)", referring to an extended version. This indicates specific benchmark instances were used, but no information or link is provided in this paper for public access to these datasets or if they are well-known public datasets.
Dataset Splits No The paper mentions using "6 MASs" for experiments but does not provide any details regarding dataset splits (e.g., training, validation, test sets, or percentages).
Hardware Specification Yes The results, obtained on a consumer laptop with 16 GB of memory
Software Dependencies No The paper mentions: "implemented the proposed compositional verification procedure in a prototype in Python using the Spot automata library (Duret-Lutz et al. 2022)." However, specific version numbers for Python or the Spot library are not provided.
Experiment Setup No The paper does not provide specific experimental setup details such as hyperparameters, training configurations, or system-level settings for the evaluation.