Skip to content

feat(model-capabilities): humanize Databricks UC model families - #6955

Merged
wpfleger96 merged 3 commits into
mainfrom
duncan/uc-humanize-manifest
Aug 27, 2026
Merged

feat(model-capabilities): humanize Databricks UC model families#6955
wpfleger96 merged 3 commits into
mainfrom
duncan/uc-humanize-manifest

Conversation

@wpfleger96

@wpfleger96 wpfleger96 commented Aug 27, 2026

Copy link
Copy Markdown
Member

Chat-eligible Unity Catalog models from the Gemini, DeepSeek, GLM, Grok, Llama, Qwen, Gemma, and Inkling families were rendering as raw FQNs such as system.ai.gemini-3-5-flash in the agent model picker. #6918 surfaces these models, but the capability manifest carried no records for most of them and the registry-label path could not strip their Unity Catalog or goose- prefixes.

I added a display-only label_family_tokens list and databricks_v2 exact records for the sixteen previously unlabeled endpoint stems. All 26 target FQNs and their goose- aliases now resolve to curated labels through databricks_registry_label, while capability resolution continues to use only the existing family_tokens (claude-, gpt-, and kimi-). This keeps label discovery from changing capability profiles for unrelated model IDs.

Each new record includes reconciliation metadata against the pinned models.dev catalog. Nine records adopt first-party effort evidence that the Databricks MLflow Chat transport can express: Gemini 3.5 Flash, Gemini 3.5 Flash Lite, Gemini 3.6 Flash, Gemini 3 Pro Image, DeepSeek V4 Flash, DeepSeek V4 Pro, GLM-5.3 Flash, Grok 4.6, and Inkling. The remaining seven deliberately retain the databricks_v2/concrete_unknown fallback because upstream evidence is absent, identifies a non-reasoning model, or provides only toggle/token-budget controls that reasoning_effort cannot represent.

The normative corpus adds the sixteen exact records, four Unity Catalog alias probes, and two capability-isolation probes. Existing base vectors remain unchanged, and Rust and TypeScript consume the same strict manifest and corpus.

Related: #6918

Unity Catalog chat-eligible models from the Gemini, DeepSeek, GLM, Grok,
Llama, Qwen, Gemma, and Inkling families rendered as raw FQNs in the agent
picker because the manifest carried no records for them and its family
tokens could not strip the system.ai. / data_workflow_tools.goose.goose-
prefixes off UC FQNs.

Add the eight missing family tokens and databricks_v2 exact records for the
sixteen previously unlabeled stems, so every chat-eligible UC FQN and its
goose- alias resolves to a curated label via the existing alias path. Axes
are materialized from the databricks_v2/concrete_unknown fallback per the
#6360 precedent, since models.dev advertises no Databricks-served capability
schema for these endpoints.

Co-authored-by: Will Pfleger <pfleger.will@gmail.com>
Signed-off-by: Will Pfleger <pfleger.will@gmail.com>
@wpfleger96
wpfleger96 requested a review from a team as a code owner August 27, 2026 19:43
… evidence

Review pass 1 on #6955 found two blockers. First, adding the eight
UC family markers to family_tokens changed capability resolution
globally: strip_catalog_prefix picks the earliest boundary token, so a
label marker before a gpt-/claude- marker displaced the capability
family match for every provider (e.g. openai tenant-gemini-gpt-5-pro
lost its gpt-5-pro high-only profile). Split the label-only superset
into a new label_family_tokens array consumed solely by
databricks_registry_label and its TS mirror; capability family_tokens
stays claude-/gpt-/kimi-. Both interpreters' structs, zod schema, and
validate_manifest are updated in lockstep, and two negative capability
vectors pin the isolation.

Second, the sixteen new records defaulted all axes to the concrete_unknown
fallback despite model-level upstream evidence, contrary to the Kimi-K3
precedent. Reconcile each against the pinned models.dev api.json: adopt
first-party effort evidence for DeepSeek V4 Flash/Pro, GLM-5.3 Flash,
Grok 4.6, Gemini 3 Pro Image, and Inkling (thinking_mode none,
default_effort null, openai-standard, per MLflow-chat transport limits);
document deliberate fallback for the non-reasoning and
conflicting/unrepresentable records.

Co-authored-by: Will Pfleger <pfleger.will@gmail.com>
Signed-off-by: Will Pfleger <pfleger.will@gmail.com>
Unity Catalog spells the Gemini 3.5 and 3.6 endpoint stems with hyphens, while the pinned first-party Google catalog uses dotted model IDs. Reconcile those equivalent names so the three records expose Google's documented effort levels instead of the generic fallback.

Co-authored-by: Will Pfleger <pfleger.will@gmail.com>
Signed-off-by: Thufir <7ebdb0b67dab08a570b9faf7bbada97535673b4ccaba2cbd546ad3ba84c87fa6@buzz.block.builderlab.xyz>
@wpfleger96
wpfleger96 merged commit ae0ecd9 into main Aug 27, 2026
59 of 62 checks passed
@wpfleger96
wpfleger96 deleted the duncan/uc-humanize-manifest branch August 27, 2026 21:25
wpfleger96 pushed a commit that referenced this pull request Aug 27, 2026
…-history

* origin/main:
  feat(desktop): implement 30178 team catalog backend (#5112)
  feat(model-capabilities): humanize Databricks UC model families (#6955)
  feat(agent): discover Databricks Unity Catalog models (#6918)
  test(db): use canonical channel roster fixtures (#6819)
  preserve channel description paragraph breaks (#6946)
  fix(cli): enrich template cardinality error with per-candidate presence and profile hints (#4825)
  Fix Codex security review authorization (#6913)

Signed-off-by: Duncan <dcfd242e557282d7a1e2cf2e6877522682f1e5c6156dc92ca7d90eaedd3b0f95@buzz.block.builderlab.xyz>
wpfleger96 pushed a commit that referenced this pull request Aug 27, 2026
…arer-auth

* origin/main:
  fix(ci): bump Codex CLI to 0.150.1 to unhang security review jobs (#6962)
  feat(desktop): implement 30178 team catalog backend (#5112)
  feat(model-capabilities): humanize Databricks UC model families (#6955)
  feat(agent): discover Databricks Unity Catalog models (#6918)
  test(db): use canonical channel roster fixtures (#6819)
  preserve channel description paragraph breaks (#6946)

Signed-off-by: Duncan <dcfd242e557282d7a1e2cf2e6877522682f1e5c6156dc92ca7d90eaedd3b0f95@buzz.block.builderlab.xyz>
jrobotham-square added a commit that referenced this pull request Aug 28, 2026
…age-rw

* origin/main: (21 commits)
  fix(desktop): resolve exact typed mentions on space (#6862)
  perf(desktop): restore project context during startup (#6939)
  fix(desktop): lift right auxiliary pane above shared header backdrop (#6966)
  fix(ci): bump Codex CLI to 0.150.1 to unhang security review jobs (#6962)
  feat(desktop): implement 30178 team catalog backend (#5112)
  feat(model-capabilities): humanize Databricks UC model families (#6955)
  feat(agent): discover Databricks Unity Catalog models (#6918)
  test(db): use canonical channel roster fixtures (#6819)
  preserve channel description paragraph breaks (#6946)
  fix(cli): enrich template cardinality error with per-candidate presence and profile hints (#4825)
  Fix Codex security review authorization (#6913)
  fix(db): disable heartbeat vacuum truncation (#6898)
  chore(deps): update rui314/setup-mold digest to 7e4f20a (#6663)
  chore(deps): update dependency vitest to v4.1.11 (#6667)
  chore(deps): update dependency @tanstack/react-virtual to v3.14.10 (#6666)
  chore(deps): update ubuntu:24.04 docker digest to 33ceb71 (#6664)
  fix(projects): allow owners to delete agent projects (#6533)
  Fade expanded video controls on hover (#6926)
  fix(db): exclude kind:30179 ciphertext from brownfield FTS (#6822)
  fix(client): resurface hidden DMs from live activity (#6885)
  ...

Signed-off-by: Joel Robotham <jrobotham@squareup.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant