We invite authors of accepted papers to submit their artifacts for Repeatability Evaluation (RE). The goal is to assess whether the results presented in the paper can be independently reproduced and validated by the RE Committee (REC).
Eligibility. RE is only applicable to papers that are accepted to the conference. Accordingly, the RE process will only begin after paper acceptance notifications are released. Authors of rejected papers are not eligible to receive RE badges.
Timeline
- Submission date: February 6, 2026 (AoE)
- Notification date: March 10, 2026 (AoE)
Submission Requirements
Each artifact must include the following components:
PDF Document
- Requirements and setup instructions.
- A description of the expected reproducibility outcomes.
- Specific scenarios demonstrating how the artifact can be concretely used. Authors may also provide variations of scenarios to showcase robustness and reusability.
- A mapping between the paper outcomes and the artifact outputs:
- Each functional outcome should be identified (F1, F2, …, Fn).
- Clear step by step instructions to recreate/reproduce the functional outcomes.
- Provide a short explanation linking the outcome in the artifact to the corresponding result in the paper.
- Example: “Fi: FigureN in the paper can be recreated by running steps/script K in the artifact.”
- If exact figures cannot be recreated due to stochasticity, a reasonable justification/explanation must be provided.
Artifact Contents
- LICENSE file
- Code (fully included, not partial).
- Requirements file: a list of all dependencies necessary for running the tool.
- Recommended: provide a script for automated package installation.
- Setup Instructions: clear step-by-step guidelines to install and run the tool.
- Recommended: provide a test script that validates the installation and outputs OK if successful.
- All above materials must be packaged into a single ZIP file, not exceeding 600 MB in size.
- If the artifact requires access to an external dataset, an anonymized external link must be provided, along with clear instructions for setup/access.
- The external link must not contain or disclose any author-identifying information; otherwise, the submission may be subject to rejection.
- Once submitted, the dataset hosted at the external link must remain unchanged; any modifications after submission may result in rejection.
Platform Compatibility
- The artifact must be executable on major operating systems (macOS, Linux, Windows).
- Strongly encouraged: package the artifact as a Docker image or an OVA/OVF virtual machine, which simplifies the setup and execution process.
Important Notes
- Anonymization is mandatory. Do not include author names, institutions, or identifying metadata in files, repository history, links with author information, documents with author information, etc.
- Submissions not meeting the above requirements may be rejected.
Submission
- Please upload a ZIP file containing the artifact along with the PDF document to this portal: https://hscc-iccps26re.hotcrp.com.
- Upload the PDF (see “PDF Document” for instructions).
- Upload the Artifact ZIP file as per the submission guidelines (see “Artifact Contents”).