Skip to content

Commit 540b560

Browse files
mlcommons-botmlcommons-bot
committed
Auto-merge updates from auto-update branch
2 parents 82adc74 + 87e7070 commit 540b560

File tree

11 files changed

+205
-206
lines changed

11 files changed

+205
-206
lines changed

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|-----------|------------|------------|--------------|-------------------|
3-
| retinanet | offline | 49.593 | 0.422 | - |
3+
| retinanet | offline | 49.593 | 0.423 | - |

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/README.md‎

Lines changed: 7 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -2,10 +2,9 @@
22

33
## Host platform
44

5-
* OS version: Linux-6.11.0-1018-azure-x86_64-with-glibc2.34
5+
* OS version: Linux-6.11.0-1018-azure-x86_64-with-glibc2.39
66
* CPU version: x86_64
7-
* Python version: 3.8.18 (default, Dec 12 2024, 19:15:30)
8-
[GCC 13.2.0]
7+
* Python version: 3.12.11 (main, Jun 4 2025, 04:14:08) [GCC 13.3.0]
98
* MLC version: unknown
109

1110
## MLC Run Command
@@ -17,16 +16,16 @@ pip install -U mlcflow
1716

1817
mlc rm cache -f
1918

20-
mlc pull repo GATEOverflow@mlperf-automations --checkout=de73954c793027b286b89319b5b504df8ef4bb6b
19+
mlc pull repo mlcommons@mlperf-automations --checkout=351b8d2867f3592402015132d4e9324c29e32a5c
2120

2221

2322
```
2423
*Note that if you want to use the [latest automation recipes](https://docs.mlcommons.org/inference) for MLPerf,
25-
you should simply reload GATEOverflow@mlperf-automations without checkout and clean MLC cache as follows:*
24+
you should simply reload mlcommons@mlperf-automations without checkout and clean MLC cache as follows:*
2625

2726
```bash
28-
mlc rm repo GATEOverflow@mlperf-automations
29-
mlc pull repo GATEOverflow@mlperf-automations
27+
mlc rm repo mlcommons@mlperf-automations
28+
mlc pull repo mlcommons@mlperf-automations
3029
mlc rm cache -f
3130

3231
```
@@ -41,4 +40,4 @@ Model Precision: fp32
4140
`mAP`: `49.593`, Required accuracy for closed division `>= 37.1745`
4241

4342
### Performance Results
44-
`Samples per second`: `0.421885`
43+
`Samples per second`: `0.423324`

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/accuracy_console.out‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
1-
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/7a0e93fbf4d74a30b530764efd0c0886.conf
2-
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_3e9ab345
3-
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_3e9ab345/annotations/openimages-mlperf.json
1+
User Conf path: /home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/1ff4cd35e6884f1eab777dcaa5909300.conf
2+
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_e3d7578a
3+
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_e3d7578a/annotations/openimages-mlperf.json
44
Scenario: Offline
55
Mode: AccuracyOnly
66
Batch size: 1

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/mlc-deps.mmd‎

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -5,9 +5,9 @@ graph TD
55
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline_) --> get,mlcommons,inference,src
66
get-mlperf-inference-utils,e341e5f86d8342e5 --> get,mlperf,inference,src
77
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline_) --> get,mlperf,inference,utils
8-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_onnxruntime,_cpu,_offline_) --> detect,os
9-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_onnxruntime,_cpu,_offline_) --> detect,cpu
10-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_onnxruntime,_cpu,_offline_) --> get,sys-utils-mlc
8+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_offline,_onnxruntime_) --> detect,os
9+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_offline,_onnxruntime_) --> detect,cpu
10+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_offline,_onnxruntime_) --> get,sys-utils-mlc
1111
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> detect,os
1212
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> get,python3
1313
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> get,mlcommons,inference,src
@@ -35,23 +35,23 @@ graph TD
3535
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
3636
get-generic-python-lib,94b62a682bc44791_(_package.setuptools_) --> get,generic-python-lib,_pip
3737
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> get,generic-python-lib,_package.setuptools
38-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_onnxruntime,_cpu,_offline_) --> get,loadgen,_wg-inference
39-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_onnxruntime,_cpu,_offline_) --> get,mlcommons,inference,src
40-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_onnxruntime,_cpu,_offline_) --> get,lib,onnxruntime,lang-cpp,_cpu
41-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_onnxruntime,_cpu,_offline_) --> get,dataset,preprocessed,openimages,_validation,_NCHW,_50
42-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_onnxruntime,_cpu,_offline_) --> get,ml-model,retinanet,_onnx,_fp32
38+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_offline,_onnxruntime_) --> get,loadgen,_wg-inference
39+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_offline,_onnxruntime_) --> get,mlcommons,inference,src
40+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_offline,_onnxruntime_) --> get,lib,onnxruntime,lang-cpp,_cpu
41+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_offline,_onnxruntime_) --> get,dataset,preprocessed,openimages,_validation,_NCHW,_50
42+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_offline,_onnxruntime_) --> get,ml-model,retinanet,_onnx,_fp32
4343
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> detect,os
4444
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> detect,cpu
4545
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,python
4646
get-mlperf-inference-sut-configs,c2fbf72009e2445b --> get,cache,dir,_name.mlperf-inference-sut-configs
4747
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,sut,configs
4848
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,mlcommons,inference,src
49-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_onnxruntime,_cpu,_offline_) --> generate,user-conf,mlperf,inference,_wg-inference
49+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_offline,_onnxruntime_) --> generate,user-conf,mlperf,inference,_wg-inference
5050
compile-program,c05042ba005a4bfa --> detect,cpu
5151
compile-program,c05042ba005a4bfa --> get,compiler,gcc
5252
get-compiler-flags,31be8b74a69742f8 --> detect,cpu
5353
compile-program,c05042ba005a4bfa --> get,compiler-flags
54-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_onnxruntime,_cpu,_offline_) --> compile,cpp-program
54+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_offline,_onnxruntime_) --> compile,cpp-program
5555
benchmark-program,19f369ef47084895 --> detect,cpu
5656
benchmark-program-mlperf,cfff0132a8aa4018 --> benchmark-program,program
57-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_onnxruntime,_cpu,_offline_) --> benchmark-mlperf
57+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_offline,_onnxruntime_) --> benchmark-mlperf

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/mlc-deps.png‎

354 Bytes
Loading

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/mlc-version-info.json‎

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -67,7 +67,7 @@
6767
"script_tags": "detect-os,detect,os,info",
6868
"script_variations": "",
6969
"version": "",
70-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_onnxruntime,_cpu,_offline )"
70+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_offline,_onnxruntime )"
7171
}
7272
},
7373
{
@@ -77,7 +77,7 @@
7777
"script_tags": "detect,cpu,detect-cpu,info",
7878
"script_variations": "",
7979
"version": "",
80-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_onnxruntime,_cpu,_offline )"
80+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_offline,_onnxruntime )"
8181
}
8282
},
8383
{
@@ -87,7 +87,7 @@
8787
"script_tags": "get,sys-utils-cm,sys-utils-mlc",
8888
"script_variations": "",
8989
"version": "",
90-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_onnxruntime,_cpu,_offline )"
90+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_offline,_onnxruntime )"
9191
}
9292
},
9393
{
@@ -367,7 +367,7 @@
367367
"script_tags": "get,loadgen,inference,inference-loadgen,mlperf,mlcommons",
368368
"script_variations": "wg-inference",
369369
"version": "master",
370-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_onnxruntime,_cpu,_offline )"
370+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_offline,_onnxruntime )"
371371
}
372372
},
373373
{
@@ -377,7 +377,7 @@
377377
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
378378
"script_variations": "",
379379
"version": "master-git-938be6d711ba1a1ea9624c83234f5dcaebf5e3ee",
380-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_onnxruntime,_cpu,_offline )"
380+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_offline,_onnxruntime )"
381381
}
382382
},
383383
{
@@ -387,7 +387,7 @@
387387
"script_tags": "install,onnxruntime,get,prebuilt,lib,lang-c,lang-cpp",
388388
"script_variations": "cpu",
389389
"version": "",
390-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_onnxruntime,_cpu,_offline )"
390+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_offline,_onnxruntime )"
391391
}
392392
},
393393
{
@@ -397,7 +397,7 @@
397397
"script_tags": "get,dataset,openimages,open-images,object-detection,preprocessed",
398398
"script_variations": "validation,NCHW,50",
399399
"version": "",
400-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_onnxruntime,_cpu,_offline )"
400+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_offline,_onnxruntime )"
401401
}
402402
},
403403
{
@@ -407,7 +407,7 @@
407407
"script_tags": "get,ml-model,raw,resnext50,retinanet,object-detection",
408408
"script_variations": "onnx,fp32",
409409
"version": "",
410-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_onnxruntime,_cpu,_offline )"
410+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_offline,_onnxruntime )"
411411
}
412412
},
413413
{
@@ -477,7 +477,7 @@
477477
"script_tags": "generate,mlperf,inference,user-conf,inference-user-conf",
478478
"script_variations": "wg-inference",
479479
"version": "",
480-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_onnxruntime,_cpu,_offline )"
480+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_offline,_onnxruntime )"
481481
}
482482
},
483483
{
@@ -527,7 +527,7 @@
527527
"script_tags": "compile,program,c-program,cpp-program,compile-program,compile-c-program,compile-cpp-program",
528528
"script_variations": "",
529529
"version": "",
530-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_onnxruntime,_cpu,_offline )"
530+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_offline,_onnxruntime )"
531531
}
532532
},
533533
{
@@ -557,7 +557,7 @@
557557
"script_tags": "mlperf,benchmark-mlperf",
558558
"script_variations": "",
559559
"version": "",
560-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_onnxruntime,_cpu,_offline )"
560+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_offline,_onnxruntime )"
561561
}
562562
}
563563
]

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/os_info.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,6 @@
2828
"MLC_HOST_PYTHON_BITS": "64",
2929
"MLC_HOST_SYSTEM_NAME": "runnervmf4ws1",
3030
"+PATH": [
31-
"/home/runner/MLC/repos/local/cache/install-python-src_49e31e86/install/bin"
31+
"/home/runner/MLC/repos/local/cache/install-python-src_baa17548/install/bin"
3232
]
3333
}

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/performance_console.out‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
1-
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/aa847d04a326457287fd9ddc761c8638.conf
2-
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_3e9ab345
3-
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_3e9ab345/annotations/openimages-mlperf.json
1+
User Conf path: /home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/796e5bbe7d194324b6aef786b57a0ec9.conf
2+
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_e3d7578a
3+
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_e3d7578a/annotations/openimages-mlperf.json
44
Scenario: Offline
55
Mode: PerformanceOnly
66
Batch size: 1

0 commit comments

Comments
 (0)