Call for Evaluators

Join the Artifact Evaluation committee, learn about the latest research before everyone else, and help make science more reusable and reproducible!

Apply now: fill this self-nomination form (deadline: August 15, 2026 (AoE))

You can be located anywhere in the world as all committee discussions will happen online. AEC membership is especially suitable if you are early in your career, such as the first or second year of your PhD. You are welcome to join the AEC if you are working in any practical aspects related to computer systems, such as operating systems; runtime systems; parallel and distributed systems; storage; networking; ML for system and systems for ML; security and privacy; virtualization; software-hardware interactions; performance evaluation and workload characterization; reliability, availability, and scalability; energy and power management; and bug-finding, tracing, analyzing, and troubleshooting.

As an artifact evaluator, you will:

  • Read the papers whose artifacts you are assigned to review
  • Install, audit, and run artifacts
  • Discuss with other evaluators to award badges

Check out the evaluator guide for an overview of what artifact evaluation involves. You must carry out evaluations independently, without sharing data nor information with people outside the committee.

Please ensure you have available time during the evaluation period stated in the home page’s important dates section. We hope to assign up to 2 artifacts per evaluator, each taking around 10-20 hours to review.

This work can usually be done on your own computer, any moderately recent desktop or laptop will do. In specific cases and to the extent possible, authors will arrange their artifacts so as to run in community research testbeds or will provide remote access to their systems. If you have access to special hardware, that might come in handy, but it is by no means required.

Peer review policy: Please refer to ACM Peer Review Policy regarding the use of generative AI. In particular, please refrain from uploading submissions / artifacts to any generative AI tools for reviews. Note that these submissions / artifacts may not be the finalized versions, and they should not be disclosed outside of the review process.

Contact the chair if you have any questions.