ICCMA19: International Competition on Computational Models of Argumentation 2019 |
Website | http://www.iccma19.dmi.unipg.it |
Submission link | https://easychair.org/conferences/?conf=iccma19 |
In the following, the call for bechmarks and the call for papers.
======================================================================================
Third International Competition on Computational Models of Argumentation (ICCMA'19)
Call for Benchmarks
http://iccma19.dmi.unipg.it
======================================================================================
Argumentation is a major topic in the study of Artificial Intelligence. In particular, the problem of solving certain reasoning tasks on Dung's abstract argumentation frameworks is central to many advanced argumentation systems. The fact that many of the problems to be solved are intractable requires efficient algorithms and solvers.
The Third International Competition on Computational Models of Argumentation (ICCMA'19) will be conducted in the first half of 2019; submitted solvers will compete on a selected collection of benchmark instances.
The main goals of the competition are to provide a forum for empirical comparison of solvers, to highlight challenges to the community, to propose new directions for research and to provide a core of common benchmark instances and a representation formalism that can aid in the comparison and evaluation of solvers.
ICCMA'19 reasoning tasks are detailed in the Call for Solvers (see http://iccma19.dmi.unipg.it/calls/solvers.txt).
Challenging and representative benchmarks are essential to perform significant comparisons of solvers. We invite submissions of both real world benchmarks and benchmark generators to ensure a diverse benchmark set for the competition. In the case of (randomly) generated benchmarks we invite the submission of the generator instead of the instances. Submissions of real world benchmarks are most welcome no matter if they come directly from an application or if they have been obtained via a translation from another (argumentation) formalism.
The 2019 edition of ICCMA also includes four tracks dedicated to solvers working on dynamic frameworks. For this reason, we will collect also generators and benchmarks where each instance consists in an abstract framework (tgf or apx formatted file) and a separate file with a list of 15 modifications (at least) to the initial instance. Each one of such modifications consists of the addition or removal of a single attack: e.g., "+att(a,b)." or "-att(d,e)." (apx), or "+1 3" or "-4 2" (tgf). These files with modifications will have respectively .apxm and .tgfm extensions.
A selection of the submitted benchmark instances will be used to evaluate solvers at ICCMA'19, and it will be made available to the community after the event.
Organizers reserve the right to make this choice, which will also be based on a pre-selection of benchmarks instances, whose goal is to select only "meaningful" benchmark instances.
The input format is adapted from the last edition of the competition and detailed at http://iccma19.dmi.unipg.it/res/SolverRequirements.pdf (more details and examples can be found there).
Before
*** February 1, 2019 ***
authors of benchmarks are expected to
1) produce a 2-page paper describing their generator/benchmark (using the EasyChair style, https://easychair.org/publications/for_authors) indicating all the authors, and submit it using the link https://easychair.org/conferences/?conf=iccma19. Please check the "Benchmark/generator" button during submission.
2) provide an instance set (composed of a significant number of instances, e.g. 30) and/or an instance generator (either producing instances in apx or tgf, or both). Software needs to be submitted by using the iccma19@gmail.com email address (either directly or by using a Dropbox/GoogleDrive link).
Regarding the provided instances, an indication of which instances, either provided in an instance set, or generated with some given parameters of the generator, is expected to be "hard", or "easy", is welcome.
Contact
-------
Main contact: iccma19@gmail.com
Participants or just interested people are welcome to subscribe to argumentationcompetition@inria.fr, by sending an email with header "subscribe argumentationcompetition <your first name> <your surname>” to sympa_inria@inria.fr, in order to receive information concerning future editions of ICCMA.
Organizers
----------
Stefano Bistarelli, Department of Mathematics and Computer Science, University of Perugia, Italy
Lars Kotthoff, Department of Computer Science, University of Wyoming, USA
Theofrastos Mantadelis, Department of Mathematics and Computer Science, University of Perugia, Italy
Francesco Santini, Department of Mathematics and Computer Science, University of Perugia, Italy
Carlo Taticchi, Gran Sasso Science Institute (GSSI), L'Aquila, Italy
The ICCMA steering committee:
---------------------------
Federico Cerutti, School of Computer Science & Informatics, Cardiff University, UK
Sarah A. Gaggl, Computational Logic Group, TU Dresden, Germany
Nir Oren, Department of Computing Science, University of Aberdeen, UK
Jean-Guy Mailly, LIPADE, Université Paris Descartes, France
Matthias Thimm, Institute for Web Science and Technologies, University of Koblenz-Landau, Germany
Mauro Vallati, School of Computing and Engineering, University of Huddersfield, UK
Serena Villata, WIMMICS Research Team, INRIA Sophia Antipolis, France
======================================================================================
Third International Competition on Computational Models of Argumentation (ICCMA'19)
Call for Solvers
http://iccma19.dmi.unipg.it
======================================================================================
Argumentation is a major topic in the study of Artificial Intelligence. In particular, the problem of solving certain reasoning tasks on Dung's abstract argumentation frameworks is central to many advanced argumentation systems. The fact that many of the problems to be solved are intractable requires efficient algorithms and solvers.
The main goals of the competition are to provide a forum for empirical comparison of solvers, to highlight challenges to the community, to propose new directions for research, and to provide a core of common benchmark instances and a representation formalism that can aid in the comparison and evaluation of solvers.
After the success of ICCMA'15 and ICCMA'17 (http://argumentationcompetition.org), the Third International Competition on Computational Models of Argumentation (ICCMA'19) will be conducted in the first half of 2019. ICCMA'19 will focus on reasoning tasks in abstract argumentation frameworks. Submitted solvers will be tested on a selected collection of benchmark instances (see Call for Benchmarks: http://iccma19.dmi.unipg.it/calls/benchmarks.txt).
Solvers need to be packaged by participants in a Docker container (https://www.docker.com). Please check http://iccma19.dmi.unipg.it/res/ICCMA19_docker_manual.pdf for a condensed guide on how to create a container with Docker. Submission will be just accomplished by communicating the repository link to this container. The main advantage is to allow each solver to be delivered with its complete run time environment, with the purpose to make setup and deployment easier; moreover, a dockerized application can be launched on different platforms (e.g., Windows, Linux, macOS, and in the cloud), making it possible to rerun the experiments anywhere.
For more detailed information and guide to Docker please refer to http://iccma19.dmi.unipg.it/res/SolverRequirements.pdf.
Solvers will be evaluated based on their performance in solving the following problems:
(SE) Given an abstract argumentation framework, determine some extension;
(EE) Given an abstract argumentation framework, determine all extensions;
(DC) Given an abstract argumentation framework and some argument, decide whether the given argument is credulously inferred;
(DS) Given an abstract argumentation framework and some argument, decide whether the given argument is skeptically inferred/
The above computational problems are to be solved with respect to the following standard semantics:
(CO) Complete Semantics (SE, EE, DC, DS);
(PR) Preferred Semantics (SE, EE, DC, DS);
(ST) Stable Semantics (SE, EE, DC, DS);
(SST) Semi-stable Semantics (SE, EE, DC, DS);
(STG) Stage Semantics (SE, EE, DC, DS);
(GR) Grounded Semantics (only (SE) and (DC));
(ID) Ideal Semantics (only (SE) and (DC)).
A task is a problem under a semantics. All the tasks of a particular semantics constitute a single different track. For single-status semantics (GR and ID) only the problems SE and DC are considered (EE is equivalent to SE, and DS is equivalent to DC). Note that DC-CO and DC-PR are equivalent as well, but in order to allow the participation in the preferred track without implementing tasks on the complete semantics (or viceversa), we repeat the task.
In addition, four new tracks will be dedicated to the solution of problems over dynamic argumentation frameworks. In this case, a benchmark consists of an initial framework and an additional file storing a sequence of additions/deletions of attacks. This file will be provided through a simple text format, e.g., a sequence of "+att(a,b)." or "-att(d,e).".
The final output needs to report the solution for the initial framework and as many outputs as the number of changes. The four new tracks involve the following semantics and problems.
(CO-D) Complete Semantics (SE, EE, DC, DS), where D stands for "dynamic";
(PR-D) Preferred Semantics (SE, EE, DC, DS);
(ST-D) Stable Semantics (SE, EE, DC, DS);
(GR-D) Grounded Semantics (only (SE) and (DC)).
Besides the file with changes, we will also provide all the full frameworks (one for each change), in order to allow non-dynamic solvers to participate to these tracks as well. More info available at http://iccma19.dmi.unipg.it/res/SolverRequirements.pdf.
Developers of solvers may decide to only provide support for a subset of the above computational tasks and/or tracks (for a maximum of eleven tracks). For each task and each (dynamic) track we will provide a ranking of the performance of the submitted solvers. Awards go to the winners of tracks. Detailed evaluation and ranking rules can be found at http://iccma19.dmi.unipg.it/rules.html.
Input and output format are adapted from the last edition and detailed at http://iccma19.dmi.unipg.it/res/SolverRequirements.pdf.
The evaluation process will consist of two phases: after the registration phase, the competitors will be given a set of representative frameworks to test their solvers on their own machines. Then, authors will be allowed to submit a final version of their solver by updating its docker at the same repository link.
Registration
--------------------
The competitors first need to declare their interest to submit their solver and participate to the competition (by March 1 2019).
In order to register the solver, the competitors need to prepare their solver description (2-4 pages, using the EasyChair style: https://easychair.org/publications/for_authors), and submit it by using the link https://easychair.org/conferences/?conf=iccma19. Please check the "Solver" button during submission.
This paper also has to indicate the name and affiliations of each team member, the name of the solver, and the classical/dynamic tasks that the solver will be able to handle (a complete list can be found at http://iccma19.dmi.unipg.it/participation.html), the system architecture, which features or functions the system provides, what design choices were made and what lessons were learned. In addition, the paper has to mandatorily report the link to the public Docker repository (https://hub.docker.com) from which the solver can be pulled. If the competitors do not want to publicly offer their solver, links to private repositories can be communicated by email (iccma19@gmail.com).
Final Submission
--------------------
Registered competitors will receive a sample of the frameworks on which their solver will be tested (by mid of March).
Registered competitors are allowed to modify the submitted container with their solver until April 1, when the final version will be pulled for testing.
Note that even if Docker repository links need to be communicated by March 1 2019, dockerized solvers will not be downloaded and tested before April 1 2019 (i.e., the repository can stay empty until April 1).
Schedule
--------
The schedule of the competition activities is:
- March 1, 2019: Registration
- April 1, 2019: Final deadline for modifying containers with solvers
- August, 2019: Presentation of results at TAFA'19
Contact
-------
Main contact: iccma19@gmail.com
Participants or just interested people are welcome to subscribe to argumentationcompetition@inria.fr, by sending an email with header "subscribe argumentationcompetition <your first name> <your surname>” to sympa_inria@inria.fr, in order to receive information concerning future editions of ICCMA.
Organizers
----------
Stefano Bistarelli, Department of Mathematics and Computer Science, University of Perugia, Italy
Lars Kotthoff, Department of Computer Science, University of Wyoming, USA
Theofrastos Mantadelis, Department of Mathematics and Computer Science, University of Perugia, Italy
Francesco Santini, Department of Mathematics and Computer Science, University of Perugia, Italy
Carlo Taticchi, Gran Sasso Science Institute (GSSI), L'Aquila, Italy
The ICCMA steering committee:
---------------------------
Federico Cerutti, School of Computer Science & Informatics, Cardiff University, UK
Sarah A. Gaggl, Computational Logic Group, TU Dresden, Germany
Nir Oren, Department of Computing Science, University of Aberdeen, UK
Jean-Guy Mailly, LIPADE, Université Paris Descartes, France
Matthias Thimm, Institute for Web Science and Technologies, University of Koblenz-Landau, Germany
Mauro Vallati, School of Computing and Engineering, University of Huddersfield, UK
Serena Villata, WIMMICS Research Team, INRIA Sophia Antipolis, France