Issues

• Tracking: Add a real-time inference performance dashboard

  apache/tooling-llmao#64 · Filter by author PragmaTwice opened on Oct 26, 2026

• Match quota and budget displays to their configured periods

  apache/tooling-llmao#63 · Filter by author PragmaTwice opened on Oct 26, 2026

• Apply tier limit changes to existing API keys

  apache/tooling-llmao#62 · Filter by author PragmaTwice opened on Oct 26, 2026

• Enforce personal and project allowances in the inference request path

  apache/tooling-llmao#61 · Filter by author PragmaTwice opened on Oct 26, 2026

• Record request-level usage and distinguish quota charges from actual costs

  apache/tooling-llmao#60 · Filter by author PragmaTwice opened on Oct 26, 2026

• Replace the flat $0.32 per million tokens estimate for self-hosted models

  apache/tooling-llmao#59 · Filter by author PragmaTwice opened on Oct 26, 2026

• Distinguish cached and uncached tokens in usage and quota accounting

  apache/tooling-llmao#58 · Filter by author PragmaTwice opened on Oct 26, 2026

• Use model-specific costs for quotas instead of raw token totals

  apache/tooling-llmao#57 · Filter by author PragmaTwice opened on Oct 26, 2026

• Tracking: improve quota accounting, cost estimates, and enforcement

  apache/tooling-llmao#56 · Filter by author PragmaTwice opened on Oct 26, 2026

• Qwen Code setup instructions

  apache/tooling-llmao#55 · Filter by author pjfanning opened on Oct 25, 2026
  1

• Secrets need to be redacted

  apache/tooling-llmao#54 · Filter by author andrewmusselman opened on Oct 22, 2026

• Model names and caps: where things stand

  apache/tooling-llmao#52 · Filter by author gstein opened on Oct 13, 2026
  

• investigate HF_TOKEN

  apache/tooling-llmao#50 · Filter by author gstein opened on Oct 11, 2026

• design discussion for /models

  apache/tooling-llmao#46 · Filter by author gstein opened on Oct 7, 2026
  2

• feature request: page data for configuring coding assistants

  apache/tooling-llmao#44 · Filter by author gstein opened on Oct 4, 2026

• consider if/whether we should add custom metrics

  apache/tooling-llmao#43 · Filter by author gstein opened on Oct 3, 2026

• Get master_key from yaml instead of env vars in benchmarking scripts

  apache/tooling-llmao#35 · Filter by author andrewmusselman opened on Sep 13, 2026

• A backend error arrives as HTTP 200 with a null body

  apache/tooling-llmao#32 · Filter by author andrewmusselman opened on Sep 12, 2026

• Add MFA to login

  apache/tooling-llmao#27 · Filter by author andrewmusselman opened on Sep 9, 2026
  

• Fail fast on an unmapped port, and report the mapping back

  apache/tooling-llmao#26 · Filter by author andrewmusselman opened on Sep 8, 2026

• MCP server registration through llmao

  apache/tooling-llmao#25 · Filter by author andrewmusselman opened on Sep 8, 2026

• Two instances of one model do not need artificial model names

  apache/tooling-llmao#22 · Filter by author andrewmusselman opened on Sep 3, 2026

• SSL_VERIFY=0 is a stopgap that will outlive its reason

  apache/tooling-llmao#21 · Filter by author andrewmusselman opened on Sep 3, 2026

• make db rotates the Postgres password on every run

  apache/tooling-llmao#20 · Filter by author andrewmusselman opened on Sep 3, 2026

• p6: backup for the LiteLLM database and fleet state

  apache/tooling-llmao#19 · Filter by author andrewmusselman opened on Sep 3, 2026
  3