Skip to content

feat(nvd): retry 429ed records after conversion is completed#5389

Merged
jess-lowe merged 5 commits into
google:masterfrom
jess-lowe:feat/retry-429
Jun 1, 2026
Merged

feat(nvd): retry 429ed records after conversion is completed#5389
jess-lowe merged 5 commits into
google:masterfrom
jess-lowe:feat/retry-429

Conversation

@jess-lowe
Copy link
Copy Markdown
Contributor

@jess-lowe jess-lowe commented May 18, 2026

  • Updated RepoTags so that temporary 429 (rate limit / too many requests) errors only mark a repository as invalid for ~ 1 hr.

Copy link
Copy Markdown
Contributor

@another-rex another-rex left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's just do the first point. And rather than not setting it as invalid in the cache, set it as invalid, just with a shorter timeout than the standard 1 week. (Maybe just 1 hour is good enough, just so we are not spamming requests when multiple records relies on 1 429 host)

It'll run again in 12 hours and pick it back up.

Copy link
Copy Markdown
Contributor

@another-rex another-rex left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably need to update the PR description. Otherwise LGTM!

@jess-lowe jess-lowe merged commit 642bc6c into google:master Jun 1, 2026
26 checks passed
@jess-lowe jess-lowe deleted the feat/retry-429 branch June 1, 2026 02:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants