Updated results summary [skip ci]

mlcommons-bot · mlcommons-bot · commit bbd81e6a7283 · 2025-09-14T10:30:57.000Z
diff --git a/README.md b/README.md
@@ -1,21 +1,21 @@
 Please download [summary.xlsx](summary.xlsx) to view the most recent results. 
  ```
-[2025-09-13 00:18:38,350 submission_checker1.py:3492 INFO] Results=33, NoResults=0, Power Results=0
-[2025-09-13 00:18:38,350 submission_checker1.py:3499 INFO] ---
-[2025-09-13 00:18:38,350 submission_checker1.py:3500 INFO] Closed Results=0, Closed Power Results=0
+[2025-09-14 10:30:51,248 submission_checker1.py:3492 INFO] Results=33, NoResults=0, Power Results=0
+[2025-09-14 10:30:51,248 submission_checker1.py:3499 INFO] ---
+[2025-09-14 10:30:51,248 submission_checker1.py:3500 INFO] Closed Results=0, Closed Power Results=0
 
-[2025-09-13 00:18:38,350 submission_checker1.py:3505 INFO] Open Results=33, Open Power Results=0
+[2025-09-14 10:30:51,248 submission_checker1.py:3505 INFO] Open Results=33, Open Power Results=0
 
-[2025-09-13 00:18:38,350 submission_checker1.py:3510 INFO] Network Results=0, Network Power Results=0
+[2025-09-14 10:30:51,248 submission_checker1.py:3510 INFO] Network Results=0, Network Power Results=0
 
-[2025-09-13 00:18:38,350 submission_checker1.py:3515 INFO] ---
-[2025-09-13 00:18:38,350 submission_checker1.py:3517 INFO] Systems=26, Power Systems=0
-[2025-09-13 00:18:38,350 submission_checker1.py:3521 INFO] Closed Systems=0, Closed Power Systems=0
-[2025-09-13 00:18:38,350 submission_checker1.py:3526 INFO] Open Systems=26, Open Power Systems=0
-[2025-09-13 00:18:38,350 submission_checker1.py:3531 INFO] Network Systems=0, Network Power Systems=0
-[2025-09-13 00:18:38,350 submission_checker1.py:3536 INFO] ---
-[2025-09-13 00:18:38,350 submission_checker1.py:3541 INFO] SUMMARY: submission looks OK
-[2025-09-13 00:18:39,589 module.py:5388 INFO] -        ! call "postprocess" from /home/runner/MLC/repos/mlcommons@mlperf-automations/script/run-mlperf-inference-submission-checker/customize.py
+[2025-09-14 10:30:51,248 submission_checker1.py:3515 INFO] ---
+[2025-09-14 10:30:51,248 submission_checker1.py:3517 INFO] Systems=26, Power Systems=0
+[2025-09-14 10:30:51,248 submission_checker1.py:3521 INFO] Closed Systems=0, Closed Power Systems=0
+[2025-09-14 10:30:51,248 submission_checker1.py:3526 INFO] Open Systems=26, Open Power Systems=0
+[2025-09-14 10:30:51,248 submission_checker1.py:3531 INFO] Network Systems=0, Network Power Systems=0
+[2025-09-14 10:30:51,249 submission_checker1.py:3536 INFO] ---
+[2025-09-14 10:30:51,249 submission_checker1.py:3541 INFO] SUMMARY: submission looks OK
+[2025-09-14 10:30:52,577 module.py:5393 INFO] -        ! call "postprocess" from /home/runner/MLC/repos/mlcommons@mlperf-automations/script/run-mlperf-inference-submission-checker/customize.py
 
 ```
 
@@ -47,7 +47,7 @@ Please download [summary.xlsx](summary.xlsx) to view the most recent results.
 | 23 | MLCommons      | available      | open       | edge         | gh_macos-latest x86  | gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config  | resnet50            | resnet              | Offline    | 14.5769    | acc: 76.000                                                                                                           |                 1 | undefined                       |                          1 |                           3 | nan                      |                       0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config/resnet50/offline   | onnxruntime v1.22.1 | (darwin-24.6.0)                                  |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
 | 24 | MLCommons      | available      | open       | edge         | gh_ubuntu-latest_x86 | gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.6.0-default_config      | retinanet           | retinanet           | Offline    |  0.405224  | mAP: 76.951                                                                                                           |                 1 | AMD EPYC 7763 64-Core Processor |                          1 |                           2 | nan                      |                       0 | open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.6.0-default_config/retinanet/offline      | pytorch v2.6.0      | Ubuntu 24.04 (linux-6.8.0-1021-azure-glibc2.39)  |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
 | 25 | MLCommons      | available      | open       | edge         | gh_macos-latest x86  | gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.0-default_config  | resnet50            | resnet              | Offline    | 15.9553    | acc: 76.000                                                                                                           |                 1 | undefined                       |                          1 |                           3 | nan                      |                       0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.0-default_config/resnet50/offline   | onnxruntime v1.22.0 | (darwin-23.6.0)                                  |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
-| 26 | MLCommons      | available      | open       | edge         | gh_macos-latest x86  | gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config      | resnet50            | resnet              | Offline    |  9.41037   | acc: 76.000                                                                                                           |                 1 | undefined                       |                          1 |                           3 | nan                      |                       0 | open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline       | onnxruntime         | (darwin-24.6.0)                                  |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
+| 26 | MLCommons      | available      | open       | edge         | gh_macos-latest x86  | gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config      | resnet50            | resnet              | Offline    |  9.24205   | acc: 76.000                                                                                                           |                 1 | undefined                       |                          1 |                           3 | nan                      |                       0 | open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline       | onnxruntime         | (darwin-24.6.0)                                  |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
 | 27 | MLCommons      | available      | open       | edge         | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config     | resnet50            | resnet              | Offline    | 23.2256    | acc: 76.000                                                                                                           |                 1 | AMD EPYC 7763 64-Core Processor |                          1 |                           2 | nan                      |                       0 | open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline      | onnxruntime         | Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39) |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
 | 28 | MLCommons      | available      | open       | edge         | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config     | retinanet           | retinanet           | Offline    |  0.413064  | mAP: 76.951                                                                                                           |                 1 | AMD EPYC 7763 64-Core Processor |                          1 |                           2 | nan                      |                       0 | open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline     | onnxruntime         | Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39) |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
 | 29 | MLCommons      | available      | open       | edge         | gh_macos-latest_x86  | gh_macos-latest_x86-reference-cpu-pytorch_v2.7.0-default_config       | retinanet           | retinanet           | Offline    |  0.438894  | mAP: 76.951                                                                                                           |                 1 | undefined                       |                          1 |                           3 | nan                      |                       0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-pytorch_v2.7.0-default_config/retinanet/offline       | pytorch v2.7.0      | (darwin-23.6.0)                                  |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
diff --git a/dbversion b/dbversion
@@ -1 +1 @@
-1526
+1527
diff --git a/summary.csv b/summary.csv
@@ -25,7 +25,7 @@ MLCommons,available,open,"datacenter","gh_ubuntu-latest_x86",gh_ubuntu-latest_x8
 MLCommons,available,open,"edge","gh_macos-latest x86",gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config,resnet50,resnet,Offline,14.5769,acc: 76.000,1,"undefined",1,3,"N/A","0",open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config/resnet50/offline,"onnxruntime v1.22.1"," (darwin-24.6.0)","",1,0,v5.0,0,False,Samples/s,"fp32"
 MLCommons,available,open,"edge","gh_ubuntu-latest_x86",gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.6.0-default_config,retinanet,retinanet,Offline,0.405224,mAP: 76.951,1,"AMD EPYC 7763 64-Core Processor",1,2,"N/A","0",open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.6.0-default_config/retinanet/offline,"pytorch v2.6.0","Ubuntu 24.04 (linux-6.8.0-1021-azure-glibc2.39)","",1,0,v5.0,0,False,Samples/s,"fp32"
 MLCommons,available,open,"edge","gh_macos-latest x86",gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.0-default_config,resnet50,resnet,Offline,15.9553,acc: 76.000,1,"undefined",1,3,"N/A","0",open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.0-default_config/resnet50/offline,"onnxruntime v1.22.0"," (darwin-23.6.0)","",1,0,v5.0,0,False,Samples/s,"fp32"
-MLCommons,available,open,"edge","gh_macos-latest x86",gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config,resnet50,resnet,Offline,9.41037,acc: 76.000,1,"undefined",1,3,"N/A","0",open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline,"onnxruntime"," (darwin-24.6.0)","",1,0,v5.0,0,False,Samples/s,"fp32"
+MLCommons,available,open,"edge","gh_macos-latest x86",gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config,resnet50,resnet,Offline,9.24205,acc: 76.000,1,"undefined",1,3,"N/A","0",open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline,"onnxruntime"," (darwin-24.6.0)","",1,0,v5.0,0,False,Samples/s,"fp32"
 MLCommons,available,open,"edge","gh_ubuntu-latest x86",gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config,resnet50,resnet,Offline,23.2256,acc: 76.000,1,"AMD EPYC 7763 64-Core Processor",1,2,"N/A","0",open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline,"onnxruntime","Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39)","",1,0,v5.0,0,False,Samples/s,"fp32"
 MLCommons,available,open,"edge","gh_ubuntu-latest x86",gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config,retinanet,retinanet,Offline,0.413064,mAP: 76.951,1,"AMD EPYC 7763 64-Core Processor",1,2,"N/A","0",open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline,"onnxruntime","Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39)","",1,0,v5.0,0,False,Samples/s,"fp32"
 MLCommons,available,open,"edge","gh_macos-latest_x86",gh_macos-latest_x86-reference-cpu-pytorch_v2.7.0-default_config,retinanet,retinanet,Offline,0.438894,mAP: 76.951,1,"undefined",1,3,"N/A","0",open/MLCommons/results/gh_macos-latest_x86-reference-cpu-pytorch_v2.7.0-default_config/retinanet/offline,"pytorch v2.7.0"," (darwin-23.6.0)","",1,0,v5.0,0,False,Samples/s,"fp32"
diff --git a/summary.json b/summary.json
@@ -789,7 +789,7 @@
         "Model":"resnet50",
         "MlperfModel":"resnet",
         "Scenario":"Offline",
-        "Result":9.41037,
+        "Result":9.24205,
         "Accuracy":"acc: 76.000",
         "number_of_nodes":1,
         "host_processor_model_name":"undefined",
diff --git a/summary.xlsx b/summary.xlsx
diff --git a/summary_results.json b/summary_results.json
@@ -176,7 +176,7 @@
     "Code": "https://github.com/mlcommons/mlperf_inference_test_submissions_v5.0/tree/main/open/MLCommons/code",
     "Unique ID (e.g. for Audit)": "edge/open/MLCommons/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50",
     "ColorKey": "availableMLCommons",
-    "Performance_Result": 9.41037,
+    "Performance_Result": 9.24205,
     "Performance_Units": "Samples/s"
   },
   {

Original file line number	Diff line number	Diff line change
`@@ -176,7 +176,7 @@`
`176`	`176`	`"Code": "https://github.com/mlcommons/mlperf_inference_test_submissions_v5.0/tree/main/open/MLCommons/code",`
`177`	`177`	`"Unique ID (e.g. for Audit)": "edge/open/MLCommons/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50",`
`178`	`178`	`"ColorKey": "availableMLCommons",`
`179`		`- "Performance_Result": 9.41037,`
	`179`	`+ "Performance_Result": 9.24205,`
`180`	`180`	`"Performance_Units": "Samples/s"`
`181`	`181`	`},`
`182`	`182`	`{`