Adds initial benchmarking framework#1197

Merged

sarahyurick merged 58 commits intoNVIDIA-NeMo:mainfrom

rlratzel:nightly_dockerfile

Nov 10, 2025

Commits on Oct 24, 2025

Commits on Oct 26, 2025

Changes Dockerfile to FROM production Curator image and add benchmark deps, updates config.yaml to use the same env vars as used in tools/run.sh, updates tools/run.sh to expose env vars used for vo…
rlratzel
committed
Updates run.sh script to properly pass args to bash or start shell if no args, makes default config specified in run.py instead of run.sh
rlratzel
committed
Makes default_config_file non-private to the module.
rlratzel
committed
Merges upstream/main
rlratzel
committed
Reverts all docker/Dockerfile changes.
rlratzel
committed
Defaults to using Curator built into image but adds convenience option for using local Curator for benchmark/debug without rebuilding image, allows for env to override each of the LOCAL_ paths.
rlratzel
committed
Fixes typo in comment.
rlratzel
committed
Adds help text to run.sh and minor cleanup.
rlratzel
committed
Updates help text in run.sh for clarity.
rlratzel
committed
Removes SLACK_WEBHOOK_URL from help text since env vars used by optional sinks may be explained differently.
rlratzel
committed
Fixes typo in help text.
rlratzel
committed

Commits on Oct 27, 2025

Commits on Oct 28, 2025

Commits on Oct 30, 2025

Commits on Oct 31, 2025

Commits on Nov 4, 2025

Commits on Nov 5, 2025

Adds initial working version of requirements checking feature and support in the Slack sink.
rlratzel
committed

Commits on Nov 6, 2025

Commits on Nov 7, 2025

Updates paths to use team directory.
rlratzel
committed

Commits on Nov 10, 2025