Skip to content

Add details about rate limits for Operator deployments#2748

Open
mdlinville wants to merge 4 commits into
mainfrom
DOCS-2575
Open

Add details about rate limits for Operator deployments#2748
mdlinville wants to merge 4 commits into
mainfrom
DOCS-2575

Conversation

@mdlinville

@mdlinville mdlinville commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Description

Add details about rate limits for Operator deployments

Document the rate limits listed in
https://www.notion.so/wandbai/Rate-Limits-74e0c3a60b11443b8582610a8bbb2f2c?source=copy_link except for *ARTIFACT*.

Fixes DOCS-2575

Testing

  • Local build succeeds without errors (mint dev)
  • Local link check succeeds without errors (mint broken-links)
  • PR tests succeed

@mdlinville mdlinville requested a review from a team as a code owner June 9, 2026 23:21
@mintlify

mintlify Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
wandb 🟢 Ready View Preview Jun 9, 2026, 11:26 PM

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

📚 Mintlify Preview Links

🔗 View Full Preview

📝 Changed (3 total)

📄 Pages (3)

File Preview
platform/hosting/hosting-options/dedicated-cloud/rate-limits.mdx Rate Limits
platform/hosting/self-managed/operator.mdx Operator
platform/hosting/self-managed/rate-limits.mdx Rate Limits

🤖 Generated automatically when Mintlify deployment succeeds
📍 Deployment: 17b36de at 2026-06-10 21:42:23 UTC

Comment thread platform/hosting/self-managed/operator.mdx Outdated
@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

🔗 Link Checker Results

All links are valid!

No broken links were detected.

Checked against: https://wb-21fd5541-docs-2575.mintlify.app

@w-b-hivemind

w-b-hivemind Bot commented Jun 10, 2026

Copy link
Copy Markdown

HiveMind Sessions

1 session · 1m · $0.00

Session Agent Duration Tokens Cost Lines
Add Environment Variables Docs for Dedicated Cloud cursor 1m 0 $0.00 +32 -2
Total 1m 0 $0.00 +32 -2

View all sessions in HiveMind →

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds Operator-specific documentation for configuring rate limits via environment variables, and updates the Self-Managed and Dedicated Cloud rate-limit pages to link to the new configuration section.

Changes:

  • Added a “Set rate limits” section to the Kubernetes Operator docs, including a YAML example and env-var table.
  • Updated Self-Managed and Dedicated Cloud rate-limit pages to link readers to the Operator rate-limit configuration section.
  • Refined support guidance wording on rate-limit pages.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 4 comments.

File Description
platform/hosting/self-managed/rate-limits.mdx Updates the guidance paragraph to point to the new Operator “Set rate limits” section.
platform/hosting/self-managed/operator.mdx Adds new “Set rate limits” section with YAML example and an env-var reference table.
platform/hosting/hosting-options/dedicated-cloud/rate-limits.mdx Adds a link to the Operator “Set rate limits” section in the recommended-defaults guidance.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +1764 to +1766
For Dedicated Cloud and Self-Managed deployments that use the Operator, optionally configure rate limits by setting environment variables in `spec.values.global.extraEnv`. This example shows the default value when the variable is not set.

<Important>You must set `GORILLA_LIMITER` to the address of your Redis server.</Important>

### Set rate limits

For Dedicated Cloud and Self-Managed deployments that use the Operator, optionally configure rate limits by setting environment variables in `spec.values.global.extraEnv`. This example shows the default value when the variable is not set.
GORILLA_DEFAULT_RATE_LIMITS_GRAPHQL: "50"
GORILLA_DEFAULT_RATE_LIMITS_RUN_UPDATE_COUNT: "10"
GORILLA_DEFAULT_RATE_LIMITS_SDK_GRAPHQL_QUERY_SECONDS: "1"
GORILLA_LIMITER: "redis://[redis-service-address]:6379?ttlInSeconds=900"
Comment on lines +1785 to +1793
| Environment variable | Default | Description |
| --- | --- | --- |
| `GORILLA_DEFAULT_RATE_LIMITS_FILESTREAM` | `5` | Default filestream requests. |
| `GORILLA_DEFAULT_RATE_LIMITS_FILESTREAM_COUNT` | `5` | Filestream requests per second. |
| `GORILLA_DEFAULT_RATE_LIMITS_FILESTREAM_PER_RUN_COUNT` | `0.8` | Filestream requests per per run per second. |
| `GORILLA_DEFAULT_RATE_LIMITS_FILESTREAM_SIZE` | `10` | Filestream ingestion limit in MB per second. |
| `GORILLA_DEFAULT_RATE_LIMITS_GRAPHQL` | `50` | GraphQL requests. |
| `GORILLA_DEFAULT_RATE_LIMITS_RUN_UPDATE_COUNT` | `10` | Run metadata update requests per second. |
| `GORILLA_DEFAULT_RATE_LIMITS_SDK_GRAPHQL_QUERY_SECONDS` | `1` | SDK GraphQL query seconds budget. |
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants