Skip to content

docs: OCR v2 polish on multimodal-extraction (Helm/local HF) #2259

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
kheiss-uwzoo wants to merge 8 commits into
base: main
Choose a base branch
from
Open

docs: OCR v2 polish on multimodal-extraction (Helm/local HF) #2259

Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
0b75b03
docs: align release notes with Helm OCR v2 default
kheiss-uwzoo Jun 24, 2026
faeced3
docs: NRL OCR section polish on multimodal-extraction
kheiss-uwzoo Jun 24, 2026
9dfaf05
docs: apply audit, polish, and style fixes to OCR sections
kheiss-uwzoo Jun 24, 2026
ef10bfc
docs: style fixes in release notes (via, spacing)
kheiss-uwzoo Jun 24, 2026
d2e7103
docs: revert releasenotes OCR edit; 26.5.0 shipped Helm v1
kheiss-uwzoo Jul 2, 2026
c09805d
docs: add NVCF hosted OCR v2 default to multimodal-extraction
kheiss-uwzoo Jul 2, 2026
9ea0213
Merge branch 'main' into docs/ocr-v2-defaults
kheiss-uwzoo Jul 6, 2026
cf5a15e
Merge branch 'main' into docs/ocr-v2-defaults
kheiss-uwzoo Jul 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 10 additions & 2 deletions docs/docs/extraction/multimodal-extraction.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ Charts and infographic regions are classified with other page layout elements (t

For chart and infographic detection and modality-specific retrieval, use the default **pdfium** layout path (page-elements detection and OCR), not `extract_method="nemotron_parse"`.

For how chart-labeled PDF regions interact with captioning, refer to [Image captioning](#image-captioning).
Chart-labeled PDF regions are **not** routed through the Omni caption stage; they remain on the layout-and-OCR path. For scope and validation guidance, refer to [Image captioning](#image-captioning).

For natural-language infographic descriptions, optionally enable [image captioning](#image-captioning) and set `caption_infographics=True` when you need VLM captions on infographic regions.

Expand All @@ -74,7 +74,15 @@ For natural-language infographic descriptions, optionally enable [image captioni

Scanned PDFs and image-only pages rely on OCR and hybrid paths that combine native text extraction with OCR when needed. For extract methods such as `ocr` and `pdfium_hybrid`, refer to the [Python API reference](nemo-retriever-api-reference.md).

When you run extraction locally with Hugging Face weights, the default OCR engine is **Nemotron OCR v2**, which operates in **multilingual** mode by default. For CLI flags and API parameters, refer to [Nemotron OCR v2 — language mode](https://github.com/NVIDIA/NeMo-Retriever/blob/main/nemo_retriever/docs/cli/README.md#nemotron-ocr-v2-language-mode). For Kubernetes deployment, refer to [OCR NIM configuration](https://github.com/NVIDIA/NeMo-Retriever/blob/main/nemo_retriever/helm/README.md#ocr-nim-configuration) in the Helm chart README.
OCR artifacts depend on how you deploy.

**Helm / NIM:** The production chart deploys **Nemotron OCR v2**. For image defaults and upgrade notes, refer to [OCR NIM configuration](https://github.com/NVIDIA/NeMo-Retriever/blob/main/nemo_retriever/helm/README.md#ocr-nim-configuration) in the Helm chart README.

**Hosted remote inference (NVCF):** CPU OCR actors default to the hosted **Nemotron OCR v2** endpoint on build.nvidia.com when you do not set `ocr_invoke_url`.

**Local Hugging Face inference:** The default engine is **Nemotron OCR v2**, which operates in **multilingual** mode by default. For CLI flags and API parameters, refer to [Nemotron OCR v2 — language mode](https://github.com/NVIDIA/NeMo-Retriever/blob/main/nemo_retriever/docs/cli/README.md#nemotron-ocr-v2-language-mode).

For Kubernetes defaults and the Helm-vs-local split, refer to [OCR artifacts (Helm vs local Hugging Face)](prerequisites-support-matrix.md#nemotron-ocr-v2-language-mode) in the support matrix.

**Related**

Expand Down
Loading