Skip to content

Commit bc2d418

Browse files
mlcommons-botmlcommons-bot
committed
Auto-merge updates from auto-update branch
2 parents a64f103 + 1691ba5 commit bc2d418

File tree

13 files changed

+324
-325
lines changed

13 files changed

+324
-325
lines changed

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|----------|------------|------------|--------------|-------------------|
3-
| resnet50 | offline | 76 | 23.002 | - |
3+
| resnet50 | offline | 76 | 23.021 | - |

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config/resnet50/offline/README.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ pip install -U mlcflow
1616

1717
mlc rm cache -f
1818

19-
mlc pull repo mlcommons@mlperf-automations --checkout=b4a61f7f691e61eb4d602e97542cda5d676a949f
19+
mlc pull repo mlcommons@mlperf-automations --checkout=4687d17996da51280ef528be8d64fae6c7d43706
2020

2121

2222
```
@@ -40,4 +40,4 @@ Model Precision: fp32
4040
`acc`: `76.0`, Required accuracy for closed division `>= 75.6954`
4141

4242
### Performance Results
43-
`Samples per second`: `23.0023`
43+
`Samples per second`: `23.0209`

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config/resnet50/offline/accuracy_console.out‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
1-
python3 python/main.py --profile resnet50-onnxruntime --model "/home/runner/MLC/repos/local/cache/download-file_ml-model-resnet_8ba4dc6a/resnet50_v1.onnx" --dataset-path /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_7ff75a30 --output "/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_8e9cb9cd/test_results/gh_ubuntu-latest x86-reference-cpu-onnxruntime-v1.22.1-default_config/resnet50/offline/accuracy" --scenario Offline --count 500 --threads 4 --user_conf /home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/c80321da87e54b67adad8044615905be.conf --accuracy --use_preprocessed_dataset --cache_dir /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_7ff75a30 --dataset-list /home/runner/MLC/repos/local/cache/extract-file_imagenet-aux-da_aad4bb4c/val.txt
2-
INFO:main:Namespace(dataset='imagenet', dataset_path='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_7ff75a30', dataset_list='/home/runner/MLC/repos/local/cache/extract-file_imagenet-aux-da_aad4bb4c/val.txt', data_format=None, profile='resnet50-onnxruntime', scenario='Offline', max_batchsize=32, model='/home/runner/MLC/repos/local/cache/download-file_ml-model-resnet_8ba4dc6a/resnet50_v1.onnx', output='/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_8e9cb9cd/test_results/gh_ubuntu-latest x86-reference-cpu-onnxruntime-v1.22.1-default_config/resnet50/offline/accuracy', inputs=None, outputs=['ArgMax:0'], backend='onnxruntime', device=None, model_name='resnet50', threads=4, qps=None, cache=0, cache_dir='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_7ff75a30', preprocessed_dir=None, use_preprocessed_dataset=True, accuracy=True, find_peak_performance=False, debug=False, user_conf='/home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/c80321da87e54b67adad8044615905be.conf', audit_conf='audit.config', time=None, count=500, performance_sample_count=None, max_latency=None, samples_per_query=8)
1+
python3 python/main.py --profile resnet50-onnxruntime --model "/home/runner/MLC/repos/local/cache/download-file_ml-model-resnet_6fa63f05/resnet50_v1.onnx" --dataset-path /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_054aaa56 --output "/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_1f91df94/test_results/gh_ubuntu-latest x86-reference-cpu-onnxruntime-v1.22.1-default_config/resnet50/offline/accuracy" --scenario Offline --count 500 --threads 4 --user_conf /home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/b0c18d649eea4e9a89b398b000cf170b.conf --accuracy --use_preprocessed_dataset --cache_dir /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_054aaa56 --dataset-list /home/runner/MLC/repos/local/cache/extract-file_imagenet-aux-da_a7d46cf3/val.txt
2+
INFO:main:Namespace(dataset='imagenet', dataset_path='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_054aaa56', dataset_list='/home/runner/MLC/repos/local/cache/extract-file_imagenet-aux-da_a7d46cf3/val.txt', data_format=None, profile='resnet50-onnxruntime', scenario='Offline', max_batchsize=32, model='/home/runner/MLC/repos/local/cache/download-file_ml-model-resnet_6fa63f05/resnet50_v1.onnx', output='/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_1f91df94/test_results/gh_ubuntu-latest x86-reference-cpu-onnxruntime-v1.22.1-default_config/resnet50/offline/accuracy', inputs=None, outputs=['ArgMax:0'], backend='onnxruntime', device=None, model_name='resnet50', threads=4, qps=None, cache=0, cache_dir='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_054aaa56', preprocessed_dir=None, use_preprocessed_dataset=True, accuracy=True, find_peak_performance=False, debug=False, user_conf='/home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/b0c18d649eea4e9a89b398b000cf170b.conf', audit_conf='audit.config', time=None, count=500, performance_sample_count=None, max_latency=None, samples_per_query=8)
33
INFO:imagenet:Loading 500 preprocessed images using 4 threads
44
INFO:imagenet:loaded 500 images, cache=0, already_preprocessed=True, took=0.0sec
55
INFO:main:starting TestScenario.Offline
6-
TestScenario.Offline qps=0.73, mean=13.6971, time=21.803, acc=76.000%, queries=16, tiles=50.0:13.8135,80.0:21.0556,90.0:21.5006,95.0:21.5574,99.0:21.6204,99.9:21.6345
6+
TestScenario.Offline qps=0.74, mean=13.5937, time=21.718, acc=76.000%, queries=16, tiles=50.0:13.7670,80.0:20.5114,90.0:21.4059,95.0:21.4436,99.0:21.5295,99.9:21.5489

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config/resnet50/offline/mlc-deps.mmd‎

Lines changed: 22 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -9,15 +9,15 @@ graph TD
99
app-mlperf-inference,d775cac873ee4231_(_python,_resnet50,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline_) --> get,mlperf,inference,utils
1010
download-file,9cdc8dc41aae437e_(_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz_) --> detect,os
1111
download-and-extract,c67e81a4ce2649f5_(_extract,_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz_) --> download,file,_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz
12-
extract-file,3f0b76219d004817_(_keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_15e8b98a/caffe_ilsvrc12.tar.gz_) --> detect,os
13-
download-and-extract,c67e81a4ce2649f5_(_extract,_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz_) --> extract,file,_keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_15e8b98a/caffe_ilsvrc12.tar.gz
12+
extract-file,3f0b76219d004817_(_keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_6b6e916e/caffe_ilsvrc12.tar.gz_) --> detect,os
13+
download-and-extract,c67e81a4ce2649f5_(_extract,_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz_) --> extract,file,_keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_6b6e916e/caffe_ilsvrc12.tar.gz
1414
get-dataset-imagenet-aux,bb2c6dd8c8c64217 --> download-and-extract,_extract,_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz
1515
app-mlperf-inference,d775cac873ee4231_(_python,_resnet50,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline_) --> get,dataset-aux,imagenet-aux
16-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> detect,os
16+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> detect,os
1717
detect-cpu,586c8a43320142f7 --> detect,os
18-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> detect,cpu
18+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> detect,cpu
1919
get-sys-utils-mlc,bc90993277e84b8e --> detect,os
20-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,python
20+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,python
2121
get-generic-python-lib,94b62a682bc44791_(_onnxruntime_) --> detect,os
2222
detect-cpu,586c8a43320142f7 --> detect,os
2323
get-generic-python-lib,94b62a682bc44791_(_onnxruntime_) --> detect,cpu
@@ -27,17 +27,17 @@ graph TD
2727
get-generic-python-lib,94b62a682bc44791_(_pip_) --> detect,cpu
2828
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
2929
get-generic-python-lib,94b62a682bc44791_(_onnxruntime_) --> get,generic-python-lib,_pip
30-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,generic-python-lib,_onnxruntime
30+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,generic-python-lib,_onnxruntime
3131
download-file,9cdc8dc41aae437e_(_cmutil,_url.https://armi.in/files/resnet50_v1_op11/resnet50_v1.onnx_) --> detect,os
3232
download-and-extract,c67e81a4ce2649f5_(_url.https://armi.in/files/resnet50_v1_op11/resnet50_v1.onnx_) --> download,file,_cmutil,_url.https://armi.in/files/resnet50_v1_op11/resnet50_v1.onnx
33-
get-ml-model-resnet50,56203e4e998b4bc0_(_fp32,_onnx_) --> download-and-extract,_url.https://armi.in/files/resnet50_v1_op11/resnet50_v1.onnx
34-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,ml-model,image-classification,resnet50,raw,_fp32,_onnx
33+
get-ml-model-resnet50,56203e4e998b4bc0_(_onnx,_fp32_) --> download-and-extract,_url.https://armi.in/files/resnet50_v1_op11/resnet50_v1.onnx
34+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,ml-model,image-classification,resnet50,raw,_onnx,_fp32
3535
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_-for.mobilenet,_NCHW_) --> get,python3
3636
get-dataset-imagenet-val,7afd58d287fe4f11_(_size.500,_2012_) --> detect,os
3737
download-file,9cdc8dc41aae437e_(_cmutil,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> detect,os
3838
download-and-extract,c67e81a4ce2649f5_(_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> download,file,_cmutil,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar
39-
extract-file,3f0b76219d004817_(_keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_84071510/ILSVRC2012_img_val_500.tar_) --> detect,os
40-
download-and-extract,c67e81a4ce2649f5_(_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> extract,file,_keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_84071510/ILSVRC2012_img_val_500.tar
39+
extract-file,3f0b76219d004817_(_keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_69dca216/ILSVRC2012_img_val_500.tar_) --> detect,os
40+
download-and-extract,c67e81a4ce2649f5_(_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> extract,file,_keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_69dca216/ILSVRC2012_img_val_500.tar
4141
get-dataset-imagenet-val,7afd58d287fe4f11_(_size.500,_2012_) --> download-and-extract,file,_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar
4242
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_-for.mobilenet,_NCHW_) --> get,dataset,image-classification,original,_size.500,_2012
4343
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_-for.mobilenet,_NCHW_) --> get,dataset-aux,image-classification,imagenet-aux
@@ -62,16 +62,16 @@ graph TD
6262
get-generic-sys-util,bb0393afa8404a11_(_install,_libgl_) --> detect,sudo
6363
get-generic-sys-util,bb0393afa8404a11_(_libgl_) --> get,generic-sys-util,_install,_libgl
6464
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_-for.mobilenet,_NCHW_) --> get,generic-sys-util,_libgl
65-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,dataset,image-classification,imagenet,preprocessed,_-for.mobilenet,_NCHW
66-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,dataset-aux,image-classification,imagenet-aux
65+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,dataset,image-classification,imagenet,preprocessed,_-for.mobilenet,_NCHW
66+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,dataset-aux,image-classification,imagenet-aux
6767
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> detect,os
6868
detect-cpu,586c8a43320142f7 --> detect,os
6969
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> detect,cpu
7070
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,python
7171
get-mlperf-inference-sut-configs,c2fbf72009e2445b --> get,cache,dir,_name.mlperf-inference-sut-configs
7272
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,sut,configs
7373
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,mlcommons,inference,src
74-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> generate,user-conf,mlperf,inference,_wg-inference
74+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> generate,user-conf,mlperf,inference,_wg-inference
7575
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> detect,os
7676
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> get,python3
7777
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> get,mlcommons,inference,src
@@ -102,39 +102,39 @@ graph TD
102102
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
103103
get-generic-python-lib,94b62a682bc44791_(_package.setuptools_) --> get,generic-python-lib,_pip
104104
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> get,generic-python-lib,_package.setuptools
105-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,loadgen,_wg-inference
106-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,mlcommons,inference,src
107-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,mlcommons,inference,src
105+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,loadgen,_wg-inference
106+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,mlcommons,inference,src
107+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,mlcommons,inference,src
108108
get-generic-python-lib,94b62a682bc44791_(_package.psutil_) --> detect,os
109109
detect-cpu,586c8a43320142f7 --> detect,os
110110
get-generic-python-lib,94b62a682bc44791_(_package.psutil_) --> detect,cpu
111111
get-generic-python-lib,94b62a682bc44791_(_package.psutil_) --> get,python3
112112
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
113113
get-generic-python-lib,94b62a682bc44791_(_package.psutil_) --> get,generic-python-lib,_pip
114-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,generic-python-lib,_package.psutil
114+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,generic-python-lib,_package.psutil
115115
get-generic-python-lib,94b62a682bc44791_(_opencv-python_) --> detect,os
116116
detect-cpu,586c8a43320142f7 --> detect,os
117117
get-generic-python-lib,94b62a682bc44791_(_opencv-python_) --> detect,cpu
118118
get-generic-python-lib,94b62a682bc44791_(_opencv-python_) --> get,python3
119119
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
120120
get-generic-python-lib,94b62a682bc44791_(_opencv-python_) --> get,generic-python-lib,_pip
121-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,generic-python-lib,_opencv-python
122-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,generic-sys-util,_libgl
121+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,generic-python-lib,_opencv-python
122+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,generic-sys-util,_libgl
123123
get-generic-python-lib,94b62a682bc44791_(_numpy_) --> detect,os
124124
detect-cpu,586c8a43320142f7 --> detect,os
125125
get-generic-python-lib,94b62a682bc44791_(_numpy_) --> detect,cpu
126126
get-generic-python-lib,94b62a682bc44791_(_numpy_) --> get,python3
127127
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
128128
get-generic-python-lib,94b62a682bc44791_(_numpy_) --> get,generic-python-lib,_pip
129-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,generic-python-lib,_numpy
129+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,generic-python-lib,_numpy
130130
get-generic-python-lib,94b62a682bc44791_(_pycocotools_) --> detect,os
131131
detect-cpu,586c8a43320142f7 --> detect,os
132132
get-generic-python-lib,94b62a682bc44791_(_pycocotools_) --> detect,cpu
133133
get-generic-python-lib,94b62a682bc44791_(_pycocotools_) --> get,python3
134134
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
135135
get-generic-python-lib,94b62a682bc44791_(_pycocotools_) --> get,generic-python-lib,_pip
136-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> get,generic-python-lib,_pycocotools
136+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> get,generic-python-lib,_pycocotools
137137
detect-cpu,586c8a43320142f7 --> detect,os
138138
benchmark-program,19f369ef47084895 --> detect,cpu
139139
benchmark-program-mlperf,cfff0132a8aa4018 --> benchmark-program,program
140-
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_resnet50,_offline,_cpu,_onnxruntime,_fp32_) --> benchmark-mlperf
140+
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_onnxruntime,_cpu,_resnet50,_offline,_fp32_) --> benchmark-mlperf

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config/resnet50/offline/mlc-deps.png‎

-59 Bytes
Loading

0 commit comments

Comments
 (0)