Artifact Evaluation

A scientific paper consists of a constellation of artifacts that extend beyond the document itself: software, hardware, evaluation data and documentation, raw survey results, mechanized proofs, models, test suites, benchmarks, and so on. In some cases, the quality of these artifacts is as important as that of the document itself. Last year, 70% of accepted OSDI papers participated in the artifact evaluation process. Based on last year’s success, OSDI ‘21 will continue to run an optional artifact evaluation process.