banner

qest logo
 Call for Papers

[CfP PDF]

Changes due to COVID-19
  • QEST 2020 will be held fully online
  • We expect every accepted submission to be supported by a pre-recorded video presentation
  • The video presentation needs to be handed in together with the camera-ready version of the submission
  • The presentation will be made publicly available online (Please contact us, if you have reservations in this respect)
  • The proceedings will be available 4 weeks after the conference
  • Details w.r.t. the online platform used will be made available at a later point in time
Scope and Topics

The International Conference on Quantitative Evaluation of SysTems (QEST) is the leading forum on quantitative evaluation and verification of computer systems and networks. Areas of interest include quantitative specification methods, stochastic and non-deterministic models and metrics for performance, reliability, safety, correctness, and security. QEST is interested in both theoretical and experimental research. QEST welcomes a diversity of modelling formalisms, programming languages and methodologies that incorporate quantitative aspects such as probabilities, temporal properties and other forms of non-determinism. This includes work on the combination of quantitative evaluation and verification with machine learning techniques. Papers may advance empirical, simulation and analytic methods. Of particular interest are case studies that highlight the role of quantitative specification, modelling and evaluation in the design of systems. Systems of interest include computer hardware and software architectures, communication systems, cyber-physical systems, infrastructural systems, security systems and biological systems. Papers that describe novel tools to support the practical application of research results in all of the above areas are also welcome.

QEST 2020 will organize a special session under the topic “Predictive performance by machine learning.” Submissions that address the combination of machine learning and performance prediction are particularly welcomed. – Ph.D. students whose work is not yet finished are encouraged to register for the Ongoing Work session. This session offers opportunity to discuss, not to publish formally.

Important Dates (updated)
Abstract submission: 27 March 2020 24 April 2020
Paper submission: 3 April 2020 30 April 2020
Poster submission: 15 May 2020
Author notification: 30 May 2020 19 June 2020
Final version due: 23 June 2020 3 August 2020
Tutorials: 31 August 2020
Conference: 1–3 September 2020

All deadlines are Anywhere on Earth.

Submissions (updated)

QEST 2020 considers six types of papers:

  • Theoretical: advance our understanding, apply to non-trivial problems and be mathematically rigorous.
  • Methodological and technical: describe situations that require the development and proposal of new analysis processes and techniques.
  • Application: describes a novel application, and compares with previous results.
  • Tool: should motivate the development of the new tools and the formalisms they support, with a focus on the software architecture and practical capabilities.
  • Tool demonstration: describe a relevant tool, as well as its features, evaluation, or any other information that may demonstrate the merits of the tool.
  • Short paper: provide a shorter contribution focusing on on-going research activities, that are still not mature enough to complete a full paper.

All accepted papers will be discussed online during the conference by at least one of the authors. The QEST 2020 proceedings will be published in the Springer LNCS series and indexed by ISI Web of Science, Scopus, ACM Digital Library, dblp, Google Scholar. All submitted papers will be evaluated by at least three reviewers on the basis of their originality, technical quality, scientific or practical contribution to the state of the art, methodology, clarity, and adequacy of references.

Authors should consult Springer’s authors’ guidelines and use Springer’s LaTeX templates for the preparation of their papers. Submitted full papers must not exceed 16 pages excluding references. Short papers (including tool demonstrations) must not exceed 4 pages, also excluding references. Papers must be unpublished and not be submitted for publication elsewhere.

Tools and results reproducibility

Authors of tool papers (both regular and demonstration) must make their tools and input data available to reviewers; reproducibility of results will be taken into account during the evaluation process, and the conference will include the possibility of a remote demo session or online interaction with the authors. Authors should present use cases, distinctive features, and computational/memory requirements through motivating examples. Theoretical background need not be presented in tool demonstration papers. If accepted after peer-review, the authors may choose to have a short description (4 pages long) included in the proceedings. Tools full papers (16 pages long) must describe substantial improvements if they present new versions of existing tools.

We expect authors of tool papers (regular and short) to provide instructions detailing the steps which need to be taken to reproduce the results presented in the tool papers to ensure reproducibility. In particular, the following information should be provided:

  • Information on system requirements for running the tool, such as OS, compilers, environments, etc.
  • A link to the (publicly downloadable) tool with detailed installation instructions.
  • A detailed description of the steps taken to reproduce the results presented in the paper, referencing tables and figures. This description should be available online and a link needs to be included in the paper.
  • If possible, include also a link to a public online repository, such as bitbucket.org, github.com, or sourceforge.net.
Submission and special issue

Papers should be submitted electronically using EasyChair.

Full papers will participate in the competence for the best paper award, elected by the programme committee. We thank Springer for support with this award. A selection of the best full papers will be invited to submit an extended version of their paper to a special issue in the Performance Evaluation journal.

Springer encourages authors to include their ORCIDs in their papers. In addition, the corresponding author of each paper, acting on behalf of all of the authors of that paper, must complete and sign a Consent-to-Publish form. The corresponding author signing the copyright form should match the corresponding author marked on the paper. Once the files have been sent to Springer, changes relating to the authorship of the papers cannot be made.