SQA 2018: Scalable Question Answering Challenge Aldemar Knossos Royal & Royal Villa Heraklion, Crete, Greece, June 3-7, 2018 |
Conference website | https://project-hobbit.eu/challenges/sqa-challenge-eswc-2018/ |
Submission link | https://easychair.org/conferences/?conf=sqa2018 |
Paper Submission Deadline | March 30, 2018 |
System Submission Deadline | June 1, 2018 |
SQA 2018 - Scalable Question Answering Challenge
in conjunction with the 15th European Semantic Web Conference (ESWC 2018)
Paper submission deadline extended to March 30th
--------------------------------------------------------------------------------------
The key challenge for Scalable Question Answering over Linked Data is the need to translate a user’s information request into such a form that it can be efficiently evaluated using standard Semantic Web query processing and inferencing techniques.
Therefore, the main task of SQA Challenge is the following: given an RDF dataset and and a large volume of natural language questions or keywords, return the correct answers (or SPARQL queries that retrieves those answers).
Training dataset and documentation are available:
* Training dataset: https://figshare.com/articles/LC-QuAD_QALDformat/5818452
* Description: http://hobbitdata.informatik.uni-leipzig.de/SQAOC/Documentation.txt
In the Scalable Question Answering Challenge (SQA) users can display the capabilities of their systems using the HOBBIT platform (https://project-hobbit.eu/outcomes/hobbit-platform) provided by the homonymous H2020 project.
Participants will be expected to describe their solution and results on the training datasets over a 5 page paper. In particular, a short summary of the approach chosen, a link to the experimental results and an analysis of the strengths and weaknesses of the approach are expected.
--------------------------------------------------------------------------------------
Important Dates
--------------------------------------------------------------------------------------
Challenge papers submission deadline (5 pages document): Friday March 9th, 2018 Friday, March 30th, 2018
Challenge paper reviews: Thursday, April 26th, 2018
Notifications sent to participants and invitations to submit task results: Monday April 30th, 2018
Camera ready papers for the conference (5 pages document): Monday May 14th, 2018
Test data (and other participation tools) published: Monday May 7th, 2018
Camera ready papers for the challenge proceedings (up to 15 pages): Friday, July 6th, 2018 (tentative deadline)
Instructions for evaluation: Monday February 12th, 2018
Deadline for submission of system answers (cut-off): Friday June 1st, 2018
Proclamation of winners: During ESWC2018 closing ceremony
--------------------------------------------------------------------------------------
Organization
--------------------------------------------------------------------------------------
Giulio Napolitano, IAIS, Fraunhofer, Germany
Axel-Cyrille Ngonga Ngomo, University of Paderborn, Germany
Ricardo Usbeck, University of Paderborn, Germany
Grigorios Tzortzis, NCSR Demokritos, Greece
For the complete list of organizers and program committee members,
please visit the challenge website.
--------------------------------------------------------------------------------------
Further Information and Contact
--------------------------------------------------------------------------------------
For detailed information, including datasets and submission guidelines,
please visit the challenge website:
https://project-hobbit.eu/challenges/sqa-challenge-eswc-2018/
Contact Email: Giulio.Napolitano@iais.fraunhofer.de
--------------------------------------------------------------------------------------