Skip to content

Add a material-agnostic new-experiment runbook#9

Merged
marinerhemant merged 1 commit into
mainfrom
docs/new-experiment-runbook
Jul 24, 2026
Merged

Add a material-agnostic new-experiment runbook#9
marinerhemant merged 1 commit into
mainfrom
docs/new-experiment-runbook

Conversation

@marinerhemant

Copy link
Copy Markdown
Member

Starting on a dataset the pipeline has never seen previously meant re-deriving the same sequence by hand. scripts/pipeline/NEW_EXPERIMENT_RUNBOOK.md makes it a doc that can be followed from an experiment folder and a material name.

Six phases: survey the experiment folder → decide what science the material system supports → configure → index → analyse → report, plus a porting section.

What makes it more than a checklist:

  • Phase 0 survey works from the files, never folder names: HDF5 layout dump (do not assume /entry1/data/data), the real raster from the stage coordinates (the 45° mount makes a 10x10um folder a 20×20 µm region), the ≥4 px area filter that separates reflections from single-pixel noise spikes, and a peaks/frame → density-regime table.
  • Phase 1 decision table by material system: Ti/Zr → Burgers parent-β; steels → K-S/N-W; single-phase → chain steps 6–8 do not apply and should be skipped, not run "to see". Four checks apply regardless of material: null measured on this scan, contiguity-aware grain counts, tolerance sensitivity, and corroborating statistics tested against their own chance null.
  • Phase 4 marks each chain step with which materials it applies to, and carries the three lessons that generalize (analytic Poisson under-rejects on clustered peak fields; contiguity moved α 325→614 and β 40→27 in opposite directions; with 2,537 candidates a random orientation matches one 9% of the time).
  • Phase 6 lists every analysis script still hard-coding Ti-6Al-4V lattice constants or valid_hkls_Ti_*.csv, by file and line (10 scripts), the phase-name → symmetry mapping, and the single function holding the orientation relationship (parentbeta_reconstruct.py:49 burgers_Cv()(12,3,3); downstream code is generic in that array, but the 11/12 accept cut must be re-derived from the synthetic gate for K-S). None of these error if left alone — the nulls are simply computed against the wrong reflection list and look perfectly healthy.

Also corrects the pipeline README's claim that nothing in the directory is experiment-specific: true of the indexer, not of the analysis scripts.

Docs only; no code paths touched.

Starting on a dataset the pipeline has never seen previously meant
re-deriving the same sequence by hand. NEW_EXPERIMENT_RUNBOOK.md makes it
a doc that can be followed from an experiment folder and a material name:
survey the folder (measured raster, not folder names; HDF5 layout; peak
density regime), decide which analyses the material system actually
supports, configure, index, run the chain, report.

The decision table is the point: Ti/Zr get Burgers parent-beta, steels
need K-S/N-W, single-phase materials skip chain steps 6-8 entirely, and
four checks apply regardless of material (null measured on this scan,
contiguity-aware grain counts, tolerance sensitivity, corroboration
tested against chance).

Section 6 lists every analysis script that still hard-codes Ti-6Al-4V
lattice constants or valid_hkls_Ti_*.csv, by file and line, plus the
phase-name -> symmetry mapping and the single function holding the
orientation relationship. None of these error when left alone; the nulls
are simply computed against the wrong reflection list and look healthy.

Also corrects the README's claim that nothing in the directory is
experiment-specific -- true of the indexer, not of the analysis scripts.
@marinerhemant
marinerhemant merged commit e48a02c into main Jul 24, 2026
2 checks passed
@marinerhemant
marinerhemant deleted the docs/new-experiment-runbook branch July 24, 2026 17:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant