WSESE2018: International Workshop on Methodological Issues with Empirical Studies involving Human Subjects ICSE2018 Gothenburg, Sweden, May 26-29, 2018 |
Conference website | https://www.ese-workshops.org/ |
Submission link | https://easychair.org/conferences/?conf=wsese2018 |
Submission deadline | February 5, 2018 |
With the steep increase of empirical studies and the advent of secondary studies (aggregation or meta-study), one main concern raised by recent studies, is the quality of the primary studies (e.g., a single experiment). Concerns about different quality issues have been raised for many years, however, due to the complexity of empirical studies, not all of them seem to be solved. In particular, problems with regard to the appropriate design of experiments and the correct usage of statistical tests are crucial for the trustworthiness of the results. Consequently, we need to better understand the issues and how to mitigate, if not remove them. The workshop focuses on the empirical process, which can be seen as one measure to ensure repeatable quality. It of six consecutive steps: Definition, Design, Implementation, Execution, Analysis, and Reporting. We also address research with regard to methodological issues arising during the execution of the stages of the process. The workshop’s aim is to increase awareness on the importance of the quality and appropriateness of the methods applied during the different stages of empirical studies to get a reliable answer from an empirical study and to disseminate this knowledge to the broader SE community..
Submission Guidelines
All papers must be original and not simultaneously submitted to another journal or conference. The following paper categories are welcome:
-
Paper categories
Experience reports (8 pages max) describe the experience with conducting studies over a period of time and lessons learned that would be useful to be added to the methodological body of knowledge.
Technical papers (8 pages max) describe either studies conducted highlighting concrete results and the way they were designed and conducted to overcome challenges. Also expected in these papers are comparisons of the advances made against the state-of-the-art.
Vision / Position papers (4 pages max) are expected to describe new directions to follow in conducting empirical studies. Convincing arguments supported by clear rationale need to be included.
List of Topics
- Issues with regard to the motivation and definition of appropriate research questions.
- Issues with regard to the operationalization, e.g., missing standard metrics.
- Issues in the selection of appropriate experimental design and its consequences
- Issues in the systematic identification of threats to validity; and how to address them.
- Dealing with perceptions and biases.
- Drawing the appropriate conclusions from the findings and their generalization.
- Issues with replication, families of studies and their aggregation.
- Issues with quantitative, qualitative approaches and combined approaches.
Committees
Program Committee
- Abrahão Silvia, Uni. Politec. de Valencia, Spain
- Avgeriou Paris, Univ. of Gronningen, The Netherlands
- Baldassarre Maria Teresa, Univ. of Bari, Italy
- Carver Jeffery, Univ. of Alabahma, US
- Daneva Maya, Univ. of Twente, The Netherlands
- Franch Xavier, Technical Univ. of Catalunya, Spain
- Genero Marcela, Univ. of Castilla-La Mancha, Spain
- Heldal Rogardt, Chalmers Univ. of Tech., Sweden
- Izuireta Clem, Montana State Univ., US
- Jørgensen Magne, Simula Research Labs, Norway
- Kalinowski Marcos, PUC-Rio, Brazil
- Lassenius Caspar, Aalto Univ., Finland
- Männistö Tomi, Univ. of Helsinki, Finland
- Mendez Fernandez Daniel, Tech. Univ. Munich, Germany
- Pfahl Dietmar, Univ. of Tartu, Estonia
- Russo Barbara, Free Univ. of Bolzano-Bozen, Italy
- Seaman Carolyn, Univ. of Maryland-Baltimore County, US
- Sjøberg Dag, Univ. of Oslo, Norway
- Sira Vegas, UP Madrid, Spain
- Wagner Stefan, Univ. of Stuttgart, Germany
Organizing committee
- Andreas Jedlitschka – Fraunhofer IESE, Germany
- Laurie Williams – North Carolina State University, NC, US
Publication
Papers must describe original work not submitted or presented at other forums. Accepted papers will be published in ICSE workshop proceedings. The official publication date of the workshop proceedings is the date the ICSE proceedings are made available in the ACM Digital Library. This date may be up to two weeks prior to the first day of ICSE 2018. The official publication date affects the deadline for any patent filings related to published work.
Venue
The conference will be held in conjunction with ICSE2018 in Gothenburg, Sweden
Contact
All questions about submissions should be emailed to chairs ~ at ~ ese_workshop [dot] org