Issues

• gaia: test.sh is stricter than the official GAIA scorer and marks correct answers wrong

  harbor-framework/adapters#31 · Filter by author Mike-7777777 opened on Oct 14, 2026

• aider_polyglot: the encrypted oracle is copied into the agent's /app, and the default passphrase is in the source

  harbor-framework/adapters#30 · Filter by author Mike-7777777 opened on Oct 14, 2026

• swegym README: oracle table leaves 4 of 2438 tasks unaccounted (2396 passed + 38 errors)

  harbor-framework/adapters#25 · Filter by author Mike-7777777 opened on Oct 10, 2026

• Port ITBench-AA: adapter for the 40 public ArtificialAnalysis SRE scenarios

  harbor-framework/adapters#16 · Filter by author DanielBlei opened on Oct 7, 2026

• swegym: generated tests/test.sh runs pytest without -rA, so the oracle scores 0 (registered tasks pass)

  harbor-framework/adapters#12 · Filter by author Mike-7777777 opened on Oct 7, 2026

• Support AA-LCR 1.1 with pinned data and updated grading

  harbor-framework/adapters#4 · Filter by author anson627 opened on Oct 2, 2026