Workshop at GECCO 2021

Workshop on Understanding Reproducibility in Evolutionary Computation accepted to GECCO 2021

We have the pleasure of announcing the 1st Workshop on Understanding Reproducibility in Evolutionary Computation co-organised with Good Benchmarking Practices for Evolutionary Computation (Benchmarking@GECCO-2021), to be held online as part of GECCO 2021.

Experimental studies are prevalent in Evolutionary Computation (EC), and concerns about the reproducibility and replicability of such studies has increased in recent years, following similar discussions in other scientific fields. In this workshop, we want to raise awareness of the reproducibility issue, shed light on the obstacles when trying to reproduce results, and discuss best practices in making results reproducible as well as reporting reproducibility results.

We invite submissions of papers repeating an empirical study published in a journal or conference proceedings, either by re-using, updating or reimplementing the necessary codes and datasets, irrespectively of whether this code was published in some form at the time or not.

The original study being reproduced should not be so recent as to make the reproduction attempt trivial. Ideally, we suggest looking at studies that are at least 10 years old. However, one of the criteria for acceptance is what can the GECCO community learn from the reproducibility study. At least one of the co-authors of the submitted paper should be one of the co-authors of the original study. This condition makes sure that the reproducibility attempt is a fair attempt at reproducing the original work.

More information in http://lopez-ibanez.eu/reproducibility-gecco/