Skip to content

Fix null skills constraint in pool normalizers - #54

Merged
mojoro merged 5 commits into
mainfrom
fix/scraper-skills-null
Mar 24, 2026
Merged

Fix null skills constraint in pool normalizers#54
mojoro merged 5 commits into
mainfrom
fix/scraper-skills-null

Conversation

@mojoro

@mojoro mojoro commented Mar 24, 2026

Copy link
Copy Markdown
Owner

Summary

  • All scrapers except Arbeitnow were failing with Null constraint violation on the fields: (skills) on every cron run
  • JobPool.skills is String[] (non-nullable), but Greenhouse, Lever, Ashby, USAJobs, and Adzuna normalizers never set it
  • Added skills: [] to all five normalizers
  • USAJobs and Adzuna have never successfully populated the pool — this will be their first successful run

Test plan

  • Verified root cause via DB query on production ScrapeRun error messages
  • Ran all 6 scrapers end-to-end against dev DB: fetch → normalize → createMany
  • USAJobs (2,817 jobs) and Adzuna (850 jobs) insert without error
  • TypeScript compiles clean

@vercel

vercel Bot commented Mar 24, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
shortlist Ready Ready Preview, Comment Mar 24, 2026 10:55pm

@mojoro
mojoro merged commit 8d54249 into main Mar 24, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant