feat(pricing): add groq/qwen/qwen3.6-27b to model cost map#34611
Open
msdianprince-7 wants to merge 1 commit into
Open
feat(pricing): add groq/qwen/qwen3.6-27b to model cost map#34611msdianprince-7 wants to merge 1 commit into
msdianprince-7 wants to merge 1 commit into
Conversation
Groq serves qwen/qwen3.6-27b but it was missing from the cost map, so cost tracking for it silently defaulted to zero and get_model_info raised "This model isn't mapped yet" Pricing, context window and capability flags are taken from Groq's models API: 0.60 USD/1M input tokens, 3.00 USD/1M output tokens, 0.30 USD/1M cached input tokens, 131072 context window, 16384 max output, tools, JSON schema, reasoning and image input support Added a regression test asserting the resolved model info and the raw cost-map entry so the pricing and capability flags cannot silently drift
Contributor
Greptile SummaryAdds Groq pricing and capability metadata for Confidence Score: 5/5The PR appears safe to merge; the new model metadata is consistent across both cost maps and is covered by focused regression tests The model key, pricing, token limits, and capability flags follow existing Groq cost-map conventions, and the canonical and bundled entries are synchronized
|
| Filename | Overview |
|---|---|
| model_prices_and_context_window.json | Adds the canonical Groq model entry with internally consistent token limits, pricing, and capability fields |
| litellm/model_prices_and_context_window_backup.json | Mirrors the new model metadata from the canonical cost map without value drift |
| tests/test_litellm/llms/groq/test_groq_qwen3_6_27b_metadata.py | Adds local, network-free regression tests covering resolved and raw bundled model metadata |
Reviews (1): Last reviewed commit: "feat(pricing): add groq/qwen/qwen3.6-27b..." | Re-trigger Greptile
Contributor
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
TLDR
Problem this solves:
How it solves it:
Relevant issues
No open issue tracks this; the model is simply absent from the cost map
Linear ticket
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
@greptileaito re-request a review after pushing changes)Screenshots / Proof of Fix
Captured at commit ca07027 against a live proxy hitting the real Groq API
Before: on any commit without this entry, get_model_info("groq/qwen/qwen3.6-27b") raises "This model isn't mapped yet" and the proxy logs "not in built-in cost map ... cost fields will default to 0", so x-litellm-response-cost comes back 0
After (this commit), config points qwen3.6-27b at groq/qwen/qwen3.6-27b:
usage was 16 prompt + 15 completion tokens, and 16 * 6e-07 + 15 * 3e-06 = 5.46e-05, which matches the header exactly
Type
🆕 New Feature
Changes
Adds groq/qwen/qwen3.6-27b to model_prices_and_context_window.json and the bundled backup, with input 0.60 USD/1M, output 3.00 USD/1M, cached input 0.30 USD/1M, a 131072 context window, 16384 max output tokens, and function calling, tool choice, JSON schema, reasoning and vision flags, all sourced from Groq's models API
Adds tests/test_litellm/llms/groq/test_groq_qwen3_6_27b_metadata.py asserting the resolved model info and the raw cost-map entry so the pricing and capability flags are regression covered
Final Attestation