The steps below validate a pack, run a control reviewer that needs no API key, rank the run and upload the runs directory as an artifact. Adapt them to run your own reviewer.

Code
- uses: actions/checkout@v4
- uses: actions/setup-python@v5
  with:
    python-version: "3.12"
- run: python -m pip install -e ".[dev]"
- run: arena validate benchmark_sets/v1
- run: arena run benchmark_sets/v1 --reviewer control:perfect_patch --mode full --allow-local-execution
- run: arena leaderboard runs/ --metric validated_case_rate --beta 1.0 --include-unverified
- uses: actions/upload-artifact@v4
  with:
    name: arena-runs
    path: runs/

If your reviewer calls a paid API, keep its key in repository secrets and start the run by hand. Do not run it on every change.