Skip to content

feat: add harbor benchmark adapter - #26

Merged
minixalpha merged 4 commits into
mainfrom
feat/harbor-adapter
Aug 23, 2026
Merged

feat: add harbor benchmark adapter#26
minixalpha merged 4 commits into
mainfrom
feat/harbor-adapter

Conversation

@minixalpha

@minixalpha minixalpha commented Aug 23, 2026

Copy link
Copy Markdown
Owner

Summary

  • Add an isolated Harbor 0.21.0 workspace under benchmarks/harbor with the public adapter path harbor_adapter:NanoPyCodeAgent, keeping Harbor out of the end-user package and root dependency graph.
  • Support reproducible installation from a published version or exact Git revision, pin the uv bootstrap, probe the installed agent version, deliver task instructions through stdin, preserve benchmark-safe logging, and normalize Harbor model credentials for the Anthropic SDK.
  • Add five adapter contract tests, bilingual Harbor usage guides, an Unreleased changelog entry, and synchronized Chinese and English 0.8.x development notes.

Validation

  • uv run --frozen pytest — 129 passed.
  • uv run --project benchmarks/harbor pytest -c benchmarks/harbor/pyproject.toml benchmarks/harbor/tests — 5 passed.
  • uv run --project benchmarks/harbor harbor --version — 0.21.0.
  • A real Docker run completed the full adapter path with zero infrastructure exceptions. The task verifier passed 5 of 6 checks and returned reward 0 because the generated check_cert.py relied on cryptography, which was absent from the verifier Python environment; this was a task-solution portability failure rather than an adapter failure.
  • Root wheel inspection confirmed that neither the adapter nor Harbor is included in the end-user distribution.

@minixalpha minixalpha changed the title feat/harbor adapter feat: add harbor benchmark adapter Aug 23, 2026
@minixalpha
minixalpha merged commit ff2b527 into main Aug 23, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant