Abstract

Security research is often criticized for the poor reproducibility of its results. Unfortunately, authors seldom release the software they develop and the datasets they use to perform their experiments. This makes it difficult to compare different solutions and forces, other researchers, to undergo the tedious and error-prone task of re-implementing previous approaches and comparing solutions on different datasets, which may not be a fair comparison.
Increasingly, the security research community has embraced the formalization of artifact submission and evaluation to improve the quality of research and as a service to the community by increasing reproducibility. The intent behind artifact evaluation is to reach a place where all published research is supported by independently evaluated evidence. Leading conferences and some publications now include a “Call for Artifacts” as part of the Call for Papers and include an …

Date

January 1, 2023

Authors

Terry Benzel

Journal

IEEE Security & Privacy

Volume

21

Issue

01

Pages

4-6

Publisher

IEEE Computer Society