MIT-licensed, local-first prediction-market pipeline software (Dagster, dlt, DuckDB, dbt, Python); no bundled production data or hosted service. See Third-Party Notices.
oddsfox-pipeline is the open-source warehouse component of the private
oddsfox superproject. It ingests Polymarket, PMXT, Kalshi, and Polygon APIs,
consumes immutable Scraper reference bundles, builds market marts, and exports
documented surfaces for offline use. Non-prediction-market collection,
normalization, reference transformations, and Elo belong to oddsfox-scraper.
Order execution belongs to oddsfox-execution and is not part of this runtime.
The manual global Polymarket graph catalog
crawls Gamma events and markets, builds one cumulative textual graph mart, and
publishes the consumer-neutral oddsfox.polymarket.graph-catalog.v1 Parquet
contract. It has no schedule and does not collect prices, trades, or profiles.
The enforced ownership decision is documented in
docs/architecture/source-ownership.md.
Read the System Overview for repository boundaries and Terminology for the compact 34-term vocabulary (including working set).
| Reader | First step |
|---|---|
| Analysts | Analysts hub, then First query, Query the warehouse, Query recipes, and the Data dictionary. |
| Operators | Operators hub, then Quickstart. |
| Contributors | Contributors hub, Development guide, and CONTRIBUTING.md. |
| Integrators | Integrators hub, Terminology, Integration, and Data contracts. |
For a first warehouse, follow the full
Quickstart
(uv run python scripts/run_scope.py polymarket:wc2026 --step full).
After that install, you can inspect jobs with uv run make dagster-dev.
Schedules stay disabled until manual jobs and dbt builds are healthy.
Query an existing warehouse (default oddsfox.duckdb in the repo root; use
DUCKDB_PATH from .env when set):
duckdb oddsfox.duckdbAnalyst rules of thumb: query *_marts first; use *_observability for trust
checks. On Kalshi current marts, prefer is_actionable_live_market, then inspect
current_price_status.
See Architecture and the Warehouse reference.
See the Data dictionary and Data contracts.
Run uv run make ci-fast before ordinary pushes. Gate tables and layout
guardrails live in AGENTS.md. See Development
and CONTRIBUTING.md.
Vercel publishes the MkDocs site from main at
data.oddsfox.io. Browse locally with
uv run make docs-serve (http://127.0.0.1:8000); validate with
uv run make docs-check.