DeepTest 2020: 2nd Workshop on Testing for Deep Learning and Deep Learning for Testing 42nd International Conference on Software Engineering Seoul, South Korea, May 23-26, 2020 |
Conference website | https://deeptestconf.github.io/ |
Submission link | https://easychair.org/conferences/?conf=deeptest2020 |
Abstract registration deadline | January 22, 2020 |
Submission deadline | January 22, 2020 |
Software development is going through a paradigm shift, where decision making is increasingly shifting from hand-coded program logic to Deep Learning (DL)--popular applications of Speech Processing, Image Recognition, Robotics, Go game, etc. are using Deep Learning as their core components. Such a wide adoption of DL techniques comes with concerns about the reliability of these systems, especially when DLs are used in safety-critical systems like autonomous cars, medical diagnosis, and aircraft collision avoidance systems. Thus, it has become crucial to rigorously test these DL applications with realistic corner cases to ensure high reliability. Moreover, DLs are also applied in diverse program analysis and software testing techniques resulting in malware detection, fuzz testing, bug-finding, type-checking, etc.; DLs tend to improve the existing testing strategies by learning from past experiences. Therefore, systematically testing Deep Learning applications is an emerging and important Software Engineering problem, especially given their increasing deployment in safety-critical systems.
DeepTest is a workshop targeting research at the intersection of testing and deep learning. This interdisciplinary workshop will explore issues related to:
- Deep learning applied to software testing.
- Testing applied to Deep Learning applications.
Although the main focus is on deep learning we encourage submissions that are related more broadly to machine learning and testing and the relationship between the two.
Submission Guidelines
The workshop will consist of invited talks, presentations based on abstract submissions, and a panel discussion, where we invite all participants to contribute. We accept one type of submission:
- Presentation abstracts: 6-page papers describing novel research, which will not be included in the ACM Digital Library, but will be included in an informal pre-proceedings on the website. We very much welcome presentation abstracts about work already published elsewhere, or giving an overview of an existing system, and the format is designed not to preclude future publication. Submissions should be in ACM Master two-column format (see https://www.acm.org/publications/proceedings-template)
If you have any questions, or wonder whether your submission is in scope, please do not hesitate to contact the PC co-chairs.
More information: https://deeptestconf.github.io/index.html
Important dates (AoE)
- Submission deadline: 22 Jan 2020
- Author notification: 25 Feb 2020
- Camera-ready version: 16 Mar 2020
List of Topics
The DeepTest workshop is a forum for researchers and practitioners to share and discuss new contributions related to introducing technology (i.e., frameworks, libraries, program analyses and tool evaluation) for testing DL-based applications, and DL-based solutions to solve open testing problems (e.g., what is a bug in a DL model). Relevant topics include, but are not limited to:
- Benchmarks for evaluating DL approaches
- Techniques to aid interpretable DL techniques
- Techniques to improve designing reliable models
- DL-aided software development approaches
- DL for fault prediction, localization and repair
- Metamorphic testing as software quality assurance
- Security in DL systems
- Fault Localization and Anomaly Detection
- Use of DL for analyzing natural language-like artifacts such as code, or user reviews
- DL techniques to support automated software testing
- Formal verification of DL-based systems
- DL to aid program comprehension, program transformation, and program generation
- Safety and security of DL based systems
- New approaches to uncertainty measures and estimation
Committees
Organizing committee
- Baishakhi Ray, Columbia University
- Corina Pasareanu, NASA Ames
- Sarfraz Khurshid, The University of Texas at Austin
- Andrea Stocco, Università della Svizzera italiana (USI)
- Gunel Jahangirova, Università della Svizzera italiana (USI)
- Vincenzo Riccio, Università della Svizzera italiana (USI)
Venue
The conference will be held in Seoul Dragon City Hotel, Seoul, South Korea, co-located with the ICSE 2020 conference.
Contact
All questions about submissions should be emailed to Andrea Stocco (andrea.stocco@usi.ch)