feat: env-var consolidation, score aggregation, and ManPage env-var documentation#686

Draft

FileSystemGuy wants to merge 46 commits into

mainfrom

feat/env-var-documentation-and-reporting

Commits on Jul 5, 2026

refactor(05-01): consolidate MLPSTORAGE_* env-var names, add ENV_FALLBACK_* resolvers
FileSystemGuy
committed
refactor(05-01): drop tempdir-fallback warn block; rename downstream DEFAULT_* refs
FileSystemGuy
committed
refactor(05-01): import MLPSTORAGE_*_ENVVAR names from config, not local redefinition
FileSystemGuy
committed
refactor(05-04): rename run_summary Environment MLPERF_* rows to MLPSTORAGE_*
FileSystemGuy
committed
feat(05-03): add req_checkpoint_folder kwarg + MLPSTORAGE_ help text
FileSystemGuy
committed
feat(05-03): rewrite training --data-dir gate to D-02 verbatim template
FileSystemGuy
committed
feat(05-02): rewrite _check_universal_required_present per D-01/D-02/D-04/D-05
FileSystemGuy
committed
feat(05-03): drop required=True on --checkpoint-folder, plumb marker for run
FileSystemGuy
committed
test(05-05): rename test_config.py MLPERF_/DEFAULT_ symbols to MLPSTORAGE_/ENV_FALLBACK_
FileSystemGuy
committed
test(05-06): add env-var migration regression tests (TEST-12, D-17)
FileSystemGuy
committed
test(05-06): add import-direction invariant tests (D-11, D-18)
FileSystemGuy
committed
test(05-05): rename MLPERF_/DEFAULT_ symbols across CLI + run_summary tests
FileSystemGuy
committed
test(05-06): add loud-error contract tests (TEST-13, ENV-06, D-19)
FileSystemGuy
committed
test(05-05): delete test_main_warnings.py (D-15 / TEST-16)
FileSystemGuy
committed
test(06-03): add 6-run unet3d + 3-run resnet50 training fixtures
FileSystemGuy
committed
test(06-03): add 10-op happy + 7-op partial checkpointing fixtures
FileSystemGuy
committed
test(06-03): add vdb in-summary-recall + recall_stats fallback fixtures
FileSystemGuy
committed
test(06-03): add kvcache multi-option fixture (D-16 flattening, D-22 pass-through)
FileSystemGuy
committed
test(06-03): add whatif training fixture (D-29 skip-rules-strict anchor)
FileSystemGuy
committed
test(06-03): add multi-orgname submission fixture (D-08 collection anchor)
FileSystemGuy
committed
test(06-03): add empty-model-dir fixture (D-03 header-only anchor)
FileSystemGuy
committed
test(06-03): add degenerate fixtures (D-23 empty, NaN, missing summary)
FileSystemGuy
committed
feat(06-02): add fmean import and D-24 verbatim INVALID message constants
FileSystemGuy
committed
feat(06-02): add _aggregate_workload_metrics dispatch + four per-type helpers
FileSystemGuy
committed
docs(06-01): add Rules.md §2.1.28 aggregateResultsFile per D-30/D-34
FileSystemGuy
committed
feat(06-04): rewrite _process_workload_groups per D-05/D-23/D-26/D-27
FileSystemGuy
committed
feat(06-04): rewrite generate_reports to bottom-up build per D-02
FileSystemGuy
committed
feat(06-04): replace sorted(fieldnames) with D-11 grouped assembly
FileSystemGuy
committed
test(06-05): add 7-class aggregation regression contracts (D-19..D-29 / SC-2)
FileSystemGuy
committed
test(06-06): add reportgen output-shape + end-to-end tests; phase 6 complete
FileSystemGuy
committed
feat(07-02): add _MANPAGE_SYNC_ALLOWLIST and MANPAGE_ENV_VAR_TIERS to config.py
FileSystemGuy
committed
docs(07-03): rewrite ENVIRONMENT section as six per-tier markdown tables
FileSystemGuy
committed
docs(07-03): add Aggregate Interpretation subsection under RESULTS DIRECTORY
FileSystemGuy
committed
docs(07-03): L473/L150 --systemname bullet — drop reportgen, rename to MLPSTORAGE_
FileSystemGuy
committed
docs(07-03): L847 reportgen --systemname — required→optional + D-23 verbatim
FileSystemGuy
committed
docs(07-03): rename all MLPERF_* prose references to MLPSTORAGE_* (SC-1/SC-6)
FileSystemGuy
committed
test(07-04): add env-var/ManPage inventory sync test (DOC-05 gate)
FileSystemGuy
committed
feat(07.5-01): add S3DLIO constants and tier entries to config.py
FileSystemGuy
committed
feat(07.5-01): add Storage-backend tier to ManPage.md; extend AWS-borrowed
FileSystemGuy
committed
fix(07.5-01): update sync test to recognize 'storage-backend' as 7th canonical tier
FileSystemGuy
committed
feat(07.5-02): add _check_storage_backend_env() to Benchmark base class
FileSystemGuy
committed
feat(07.5-02): extend sync test with MANPAGE_STORAGE_BACKEND_ENV_VARS carve-out and TestStorageBackendEnvVars
FileSystemGuy
committed
feat(07.5-02): add D-14 storageBackendEnvVarDeclaration rule to Rules.md
FileSystemGuy
committed
fix: align _enumerate_on_disk_model_dirs to return <model>/run/ for training
FileSystemGuy
committed

Commits on Jul 7, 2026