Skip to content

Commit 74b47e1

Browse files
michal2409pgmpablo157321
authored andcommitted
Minor fixes for 4.1.0 submission
1 parent 9b5f1b4 commit 74b47e1

File tree

5 files changed

+7
-10
lines changed

5 files changed

+7
-10
lines changed

mlperf_logging/compliance_checker/README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ To check a log file for compliance:
1010

1111
python -m mlperf_logging.compliance_checker [--config YAML] [--usage training/hpc] [--ruleset MLPERF_EDITION] FILENAME
1212

13-
By default, 3.1.0 training edition rules are used and the default config is set to `4.1.0/common.yaml`.
13+
By default, 4.1.0 training edition rules are used and the default config is set to `4.1.0/common.yaml`.
1414
This config will check all common keys and enqueue benchmark specific config to be checked as well.
1515
Old training editions, still supported are 4.0.0, 3.1.0, 3.0.0, 2.1.0, 2.0.0, 1.1.0, 1.0.0, 0.7.0 and 0.6.0
1616

@@ -25,14 +25,14 @@ As log examples use [NVIDIA's training logs](https://github.com/mlperf/training_
2525
4.1.0/common.yaml - currently the default config file, checks common fields complience and equeues benchmark-specific config file
2626
4.1.0/closed_common.yaml - the common rules file for closed submissions. These rules apply to all benchmarks
2727
4.1.0/open_common.yaml - the common rules file for open submissions. These rules apply to all benchmarks
28-
4.1.0/closed_ssd.yaml - Per-benchmark rules, closed submissions.
28+
4.1.0/closed_ssd.yaml - Per-benchmark rules, closed submissions.
2929
4.1.0/closed_bert.yaml
3030
4.1.0/closed_dlrm_dcnv2.yaml
3131
4.1.0/closed_gpt3.yaml
3232
4.1.0/closed_gnn.yaml
3333
4.1.0/closed_llama2_70b_lora.yaml
3434
4.1.0/closed_stable_diffusion.yaml
35-
4.1.0/open_ssd.yaml - Per-benchmark rules, closed submissions.
35+
4.1.0/open_ssd.yaml - Per-benchmark rules, open submissions.
3636
4.1.0/open_bert.yaml
3737
4.1.0/open_dlrm_dcnv2.yaml
3838
4.1.0/open_gpt3.yaml

mlperf_logging/compliance_checker/training_4.1.0/closed_common.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
- KEY:
33
NAME: submission_benchmark
44
REQ: EXACTLY_ONE
5-
CHECK: " v['value'] in ['resnet', 'ssd', 'stable_diffusion', 'maskrcnn', 'gpt3', 'dlrm_dcnv2', 'bert', 'rnnt', 'unet3d', 'gnn','llama2_70b_lora'] "
5+
CHECK: " v['value'] in ['resnet', 'ssd', 'stable_diffusion', 'maskrcnn', 'gpt3', 'dlrm_dcnv2', 'bert', 'rnnt', 'unet3d', 'gnn', 'llama2_70b_lora'] "
66
POST: " enqueue_config('training_4.1.0/closed_{}.yaml'.format(v['value'])) "
77

88
- KEY:

mlperf_logging/compliance_checker/training_4.1.0/closed_llama2_70b_lora.yaml

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -7,10 +7,7 @@
77
- KEY:
88
NAME: opt_base_learning_rate
99
REQ: EXACTLY_ONE
10-
11-
- KEY:
12-
NAME: lora_alpha
13-
REQ: EXACTLY_ONE
10+
1411

1512
- KEY:
1613
NAME: opt_learning_rate_training_steps

mlperf_logging/rcp_checker/rcp_checker.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -162,7 +162,7 @@ class RCP_Checker:
162162

163163
def __init__(self, usage, ruleset, benchmark, verbose, rcp_file=None):
164164
if ruleset not in {'1.0.0', "1.1.0", "2.0.0", "2.1.0", "3.0.0", "3.1.0", "4.0.0", "4.1.0"}:
165-
raise Exception('RCP Checker only supported in 1.0.0, 1.1.0, 2.0.0, 2.1.0, 3.0.0, 3.1.0, 4.0.0, and "4.1.0"')
165+
raise Exception('RCP Checker only supported in 1.0.0, 1.1.0, 2.0.0, 2.1.0, 3.0.0, 3.1.0, 4.0.0, and 4.1.0')
166166
self.usage = usage
167167
self.ruleset = ruleset
168168
self.benchmark = benchmark

mlperf_logging/result_summarizer/config.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -75,7 +75,7 @@ columns:
7575
llama2_70b_lora: ["Benchmark results (minutes)", "LLM-Finetune", "SCROLSS Gov Report", "LLama2-70B-LoRA"]
7676
gnn: ["Benchmark results (minutes)", "Graph node classification", "IGBH-Full", "R-GAT"]
7777
default: [" ", " ", " "]
78-
"4.0.1":
78+
"4.1.0":
7979
bert: ["Benchmark results (minutes)", "NLP", "Wikipedia", "BERT"]
8080
gpt3: ["Benchmark results (minutes)", "LLM", "C4", "GPT3"]
8181
dlrm_dcnv2: ["Benchmark results (minutes)", "Recommendation", "1TB Multihot Clickthrough", "DLRM DCNv2"]

0 commit comments

Comments
 (0)