OpenSQA 2017-18: Scalable Question Answering Open Challenge 2017-2018 May 31, 2018 |
Conference website | https://project-hobbit.eu/open-challenges/sqa-open-challenge/ |
Contact Email | Giulio.Napolitano@iais.fraunhofer.de |
Submission Deadline | No deadline. Continuous Submission with periodic cutoffs |
After the successful organization of the QALD-7 challenge at the ESWC 2017 and the QALD-8 challenge incorporated in the NLIWoD workshop at ISWC 2017, with more than 50 participants, the HOBBIT project (https://project-hobbit.eu/) is proud to announce the Scalable Question Answering Open Challenge (SQA) over Linked Data which will be launched in December 2017.
SQA open challenge will run periodically with first cutoff dates in June 2018 (coinciding with ESWC 2018) and November 2018.
Therewith, the challenge will ensure continuous participation and system evaluation.
Monetary prizes will be provided to the best winning systems at each cutoff date.
Please express your interest in SQA open challenge by adding your email via the link: https://project-hobbit.eu/open-challenges/sqa-open-challenge/express-interest. You will receive further information and notifications regarding the progress of SQA open challenge.
Stay tuned and get ready to participate!
Important Dates
Dry-Run December 2017 to January 2018
Release of the test questions without answers TBA
Training Phase* February to April 2018
Test Phase May 2018
Proclamation of results 3rd of June 2018
*Weekly release of evaluation results from the end of January onwards
Prizes
The winner of the challenge will receive a prize of 250€
SQA Open Challenge at a glance
The key challenge for Scalable Question Answering over Linked Data is in the need to translate a user’s information request into such a form that it can be efficiently evaluated using standard Semantic Web query processing and inferencing techniques.
Therefore, the main task of SQA open challenge is the following: given an RDF dataset and and a large volume of natural language questions or keywords, return the correct answers (or SPARQL queries that retrieves those answers).
Small test Data and Documentation are available for SQA open challenge:
-
Sample dataset: http://hobbitdata.informatik.uni-leipzig.de/SQAOC/sqaoc-sample-largescale.json
- Description: http://hobbitdata.informatik.uni-leipzig.de/SQAOC/Documentation.txt
Organization
Giulio Napolitano, IAIS, Fraunhofer, Germany
Axel-Cyrille Ngonga Ngomo, University of Paderborn, Germany
Ricardo Usbeck, University of Paderborn, Germany
Further Information and Contact
For detailed information including datasets and submission guidelines,
please visit the challenge website: https://project-hobbit.eu/challenges/sqa-open-challenge
Contact Email: Giulio.Napolitano@iais.fraunhofer.de