Skills evaluation and curation

[ramakrishnap-nv]

Grow eval coverage per skill, add GPU-based eval, and add/remove skills based on eval results.

Already landed (post-26.06):

• Evals added: evals: add 3 formulation evals for cuopt-numerical-optimization-formulation skill #1398, evals: add 3 Python API evals for cuopt-numerical-optimization-api-python skill #1418, evals: add 3 C API evals for cuopt-numerical-optimization-api-c skill #1417, evals: add benchmark evals for cuopt-developer skill #1399, skills/cuopt-skill-evolution: add eval #1337, skills/cuopt-numerical-optimization-api-c: Add eval #1327, skills/cuopt-install:Add eval #1324, skills/cuopt-server-common: Add eval #1325, skills: add evals/evals.json smoke suite  #1302/skills: add evals/evals.json smoke suite (group A) #1308, skills(multi-objective): trigger re-eval after adding eval-005 #1460 (plus benchmark-detail updates skills/cuopt-numerical-optimization-api-cli: update with benchmark details #1331–skills/cuopt-user-rules: update with benchmark details #1335)
• Curation/consolidation: consolidate 3 API skills (skills: consolidate three numerical-optimization API skills into one #1489), remove redundant concept-only skills (skills: remove redundant concept-only skills #1487), namespace refactor sweep (skills(cuopt-developer): update for mathematical_optimization namespace refactor #1475–skills(cuopt-user-rules): update for mathematical_optimization namespace refactor #1480), catalog onboarding (skills: prep for nvidia/skills catalog onboarding #1310/cuopt-install: catalog onboarding prep #1343/cuopt-numerical-optimization-api-python: catalog onboarding prep #1344/cuopt-numerical-optimization-formulation: catalog onboarding prep #1345), skill renames (Rename numerical-optimization-formulation to cuopt-numerical-optimization-formulation #1328–Rename skill-evolution to cuopt-skill-evolution #1330)

Remaining (no PRs yet):

• GPU-based evaluation for APIs — S
• Finalize NVCarps integration — XS
• Ongoing add/remove of skills from eval results — S

Owner: Ram · Release: 26.08

[github-actions]

🔔 Hi @anandhkb @tmckayus, this issue has had no activity for 21 days. Please update or let us know if it can be closed. Thank you!

If this is an "epic" issue, then please add the "epic" label to this issue.
If it is a PR and not ready for review, then please convert this to draft.
If you just want to switch off this notification, then use the "skip inactivity reminder" label.