From 8ae91b94b6da32d17fb3c21786386fffe7b979f4 Mon Sep 17 00:00:00 2001 From: Amir Fathi Date: Mon, 31 Aug 2026 05:37:21 +0000 Subject: [PATCH] docs(skill-evals): add --cli to workflow-security-audit and license-compliance-audit READMEs Both READMEs document run commands without --cli, so following them verbatim drives the runner in print mode: prose and structured cases report MANUAL instead of PASS/FAIL. Both suites use exact-match expected.json (enums/booleans), the same shape onboarding-concierge documents as gradable via --cli, so this is a doc gap, not intended behavior. Generated-by: Claude Code (Sonnet 5) Signed-off-by: Amir Fathi --- .../skill-evals/evals/license-compliance-audit/README.md | 9 ++++++--- .../skill-evals/evals/workflow-security-audit/README.md | 7 ++++--- 2 files changed, 10 insertions(+), 6 deletions(-) diff --git a/tools/skill-evals/evals/license-compliance-audit/README.md b/tools/skill-evals/evals/license-compliance-audit/README.md index 26f0aa6d4..b11c1bbf3 100644 --- a/tools/skill-evals/evals/license-compliance-audit/README.md +++ b/tools/skill-evals/evals/license-compliance-audit/README.md @@ -16,13 +16,16 @@ Behavioral evals for the `license-compliance-audit` skill. ```bash # All cases -uv run --project tools/skill-evals skill-eval tools/skill-evals/evals/license-compliance-audit/ +uv run --project tools/skill-evals skill-eval --cli "claude -p" \ + tools/skill-evals/evals/license-compliance-audit/ # Single suite -uv run --project tools/skill-evals skill-eval tools/skill-evals/evals/license-compliance-audit/step-scope-selection/ +uv run --project tools/skill-evals skill-eval --cli "claude -p" \ + tools/skill-evals/evals/license-compliance-audit/step-scope-selection/ # Single case -uv run --project tools/skill-evals skill-eval tools/skill-evals/evals/license-compliance-audit/step-scope-selection/fixtures/case-1-explicit-repo/ +uv run --project tools/skill-evals skill-eval --cli "claude -p" \ + tools/skill-evals/evals/license-compliance-audit/step-scope-selection/fixtures/case-1-explicit-repo/ ``` ## What the suites cover diff --git a/tools/skill-evals/evals/workflow-security-audit/README.md b/tools/skill-evals/evals/workflow-security-audit/README.md index 07ec4ef80..804cc0d68 100644 --- a/tools/skill-evals/evals/workflow-security-audit/README.md +++ b/tools/skill-evals/evals/workflow-security-audit/README.md @@ -16,14 +16,15 @@ Behavioral evals for the `workflow-security-audit` skill. ```bash # All cases -uv run --project tools/skill-evals skill-eval tools/skill-evals/evals/workflow-security-audit/ +uv run --project tools/skill-evals skill-eval --cli "claude -p" \ + tools/skill-evals/evals/workflow-security-audit/ # Single suite -uv run --project tools/skill-evals skill-eval \ +uv run --project tools/skill-evals skill-eval --cli "claude -p" \ tools/skill-evals/evals/workflow-security-audit/step-scope-selection/fixtures/ # Single case -uv run --project tools/skill-evals skill-eval \ +uv run --project tools/skill-evals skill-eval --cli "claude -p" \ tools/skill-evals/evals/workflow-security-audit/step-scope-selection/fixtures/case-1-explicit-repo ```