IWCT 2021 is to be held in conjunction with ICST 2021 (going virtual), focusing on combinatorial testing. The workshop welcomes academic research submissions, as well as industrial experience reports.
Combinatorial Testing (CT), or Combinatorial Interaction Testing (CIT), is a widely applicable generic methodology and technology for software verification and validation, considered a testing best practice. In a combinatorial test plan, all interactions between parameters up to a certain level are covered. For example, in pairwise testing, for every pair of parameters, every pair of values will appear at least once. Studies show that CT is more efficient and effective than random testing.
CT has gained significant interest in recent years, both in research and in practice. However, many issues still remain unresolved, and much research is still needed in the field. For example, while pairwise testing is a well recognized and popular test planning method, investigations of actual failures in a number of software and systems convincingly show that pairwise testing is usually not sufficient, so high strength CT (i.e., t-way for t > 2) may be needed.
In addition, the combinatorial test suites need to exclude invalid combinations of test values that cannot be executed, which limits the degrees of freedom the algorithms have, thus complicating the problem. Moreover, modeling languages and tools for easily capturing the input test space are also required for real-life applicability of CT. Other obstacles for wide acceptance of CT in industry are the gap between the generated test plans and executable tests, and the difficulty in determining expected results for the generated tests. Finally, empirical studies on CT, as well as thorough comparison with other methods are also required.
In this workshop, we plan to bring together researchers actively working on combinatorial testing, and create a productive and creative environment for sharing and collaboration. Since there is no other venue dedicated to CT, yet there are many researchers working in the field, we expect, like in previous years, to see high responsiveness to take part in the workshop. Researchers attending the workshop will have an opportunity to publish their work in a dedicated venue, create new collaborations and take active part in the growing community of researchers working in the field.
The workshop will also be a meeting place between academia and industry, thus uniting academic excellence and industrial experience and needs. This will allow participants from academia to learn about the industrial experience in practical application of CT to real-life testing problems, and together with the colleagues from industry identify the difficulties that are obstacle to wider application of CT, and should be addressed in future research. Industrial participants will have an opportunity to meet the leading scientists in the field, and hear about the latest advances and innovations.
Full and Short Papers : We invite submissions of high-quality papers presenting original work on both theoretical and practical aspects of combinatorial testing. We accept both full papers (up to 10 pages) and short papers (up to 4 pages).
Poster Session: We will also have a poster session, for authors to present their work in an informal and interactive setting. We encourage submissions presenting research work in progress or important conclusions from practical experience.
In particular, we welcome posters focusing on:
An extended abstract of the poster (up to 2 pages) should be submitted for review by the submission deadline. Accepted poster abstracts will be included in the proceedings.
Topics of interest for full and short papers include, but are not limited to:
Accepted papers and posters will be presented at the workshop. All full and short papers, as well as extended abstracts, will be published in the IEEE Digital Library - provided that at least one author registers and presents at the workshop (standard IEEE policy).
This edition of IWCT will feature two best paper awards in the categories of "best foundation/modelling paper" and "best CT application paper".
IWCT 2021 submissions should be made at the EasyChair submission site: https://easychair.org/conferences/?conf=iwct2021.
All submissions should be in PDF format, and will be peer-reviewed. IWCT uses single-blind reviewing, so please include all author names and affiliations. Papers must neither have been previously accepted for publication nor be under submission in another conference or journal.
Research papers must conform to the two-column IEEE conference publication format. Templates for Latex and Word are available here; use the letter format templates and the “conference” option (i.e., not the Computer Society format).
Extended abstracts must conform to the same two-column IEEE conference publication format as for research papers. Extended abstracts are also subject to peer-review from the workshop's program committee.
To be announced.
To be announced.
SBA Research, Austria
Graz University of Technology, Austria
Nanjing University, China
Microsoft Research, USA
University of Bergamo, Italy
IBM Research, Israel
University of Texas Arlington, USA