Shared results from collaborative experiments

Live CK scoreboards are connected with portable CK workflows and adaptive containers to help the community participate in collaborative AI/ML/SW/HW benchmarking and DSE. See this paper and ACM TechTalk for more details.

Benchmark results (performance): P_*_SS - Single Stream in milliseconds, P_*_MS - MultiStream in no. streams, P_*_S - Server in QPS, P_*_O - Offline in inputs/second.
Benchmark results (accuracy): A_IC* - Top-1, A_OD* - mAP, A_NMT* - BLEU.
cK components: packages, software detection plugins.
Image Classification: IC1 - ImageNet, MobileNet-v1, IC2 - ImageNet, ResNet-50 v1.5.
Object detection: OD1 - COCO, SSD w/ MobileNet-v1, OD2 - COCO 1200x1200, SSD w/ ResNet-34.
Translation: NMT - WMT E-G, NMT.
Form Factor: FF_M - Mobile/Handheld, FF_D - Desktop/Workstation, FF_S - Server, FF_E - Edge/Embedded.
These are not official results but a snapshot to collaboratively reproduce results and add portable workflows!
MLPerf name and logo are trademarks. See www.mlperf.org for more information.

Reproduced paper: MLPerf Inference Benchmark
Related reusable solutions: 1 2 3 4 5 6 7

SOTA: MLPerf inference benchmark v0.5 results snapshot (open, Available) for collaborative validation

Versions

1.0.0 (2020-04-12)

Files

result-100.json (1436 bytes)
result-101.json (1436 bytes)
result-106.json (1436 bytes)
result-113.json (1434 bytes)
result-115.json (1435 bytes)
result-118.json (1489 bytes)
result-125.json (1489 bytes)
result-126.json (1490 bytes)
result-127.json (1490 bytes)
result-131.json (1489 bytes)
result-133.json (1490 bytes)
result-138.json (1489 bytes)
result-141.json (1485 bytes)
result-145.json (1490 bytes)
result-148.json (1489 bytes)
result-149.json (1489 bytes)
result-155.json (1492 bytes)
result-159.json (1491 bytes)
result-16.json (1424 bytes)
result-166.json (1482 bytes)
result-17.json (1424 bytes)
result-170.json (1483 bytes)
result-180.json (1482 bytes)
result-183.json (1492 bytes)
result-186.json (1483 bytes)
result-199.json (1483 bytes)
result-20.json (1423 bytes)
result-200.json (1480 bytes)
result-209.json (1423 bytes)
result-210.json (1423 bytes)
result-211.json (1423 bytes)
result-213.json (1422 bytes)
result-215.json (1422 bytes)
result-217.json (1423 bytes)
result-223.json (1423 bytes)
result-227.json (1423 bytes)
result-228.json (1419 bytes)
result-231.json (1422 bytes)
result-233.json (1419 bytes)
result-238.json (1420 bytes)
result-239.json (1422 bytes)
result-250.json (1417 bytes)
result-254.json (1416 bytes)
result-255.json (1426 bytes)
result-262.json (1418 bytes)
result-264.json (1418 bytes)
result-28.json (1424 bytes)
result-280.json (1417 bytes)
result-281.json (1418 bytes)
result-283.json (1416 bytes)
result-288.json (1416 bytes)
result-29.json (1424 bytes)
result-290.json (1418 bytes)
result-301.json (1445 bytes)
result-303.json (1446 bytes)
result-307.json (1444 bytes)
result-310.json (1445 bytes)
result-312.json (1445 bytes)
result-317.json (1446 bytes)
result-318.json (1446 bytes)
result-319.json (1446 bytes)
result-328.json (1446 bytes)
result-337.json (1445 bytes)
result-340.json (1508 bytes)
result-344.json (1507 bytes)
result-345.json (1507 bytes)
result-348.json (1508 bytes)
result-353.json (1507 bytes)
result-354.json (1508 bytes)
result-362.json (1505 bytes)
result-363.json (1504 bytes)
result-367.json (1508 bytes)
result-37.json (1424 bytes)
result-372.json (1506 bytes)
result-376.json (1505 bytes)
result-377.json (1484 bytes)
result-381.json (1482 bytes)
result-388.json (1529 bytes)
result-390.json (1514 bytes)
result-398.json (1510 bytes)
result-399.json (1496 bytes)
result-406.json (1501 bytes)
result-407.json (1518 bytes)
result-408.json (1514 bytes)
result-42.json (1424 bytes)
result-50.json (1419 bytes)
result-54.json (1418 bytes)
result-61.json (1428 bytes)
result-65.json (1429 bytes)
result-66.json (1419 bytes)
result-67.json (1429 bytes)
result-68.json (1418 bytes)
result-71.json (1426 bytes)
result-79.json (1419 bytes)
result-80.json (1411 bytes)
result-81.json (1418 bytes)
result-85.json (1414 bytes)
result-9.json (1423 bytes)
result-90.json (1416 bytes)
result-95.json (1414 bytes)

Comments

Please log in to add your comments!

If you notice any inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!

SOTA: MLPerf inference benchmark v0.5 results snapshot (open, Available) for collaborative validation

Versions Hide

Files Hide

Comments Hide

Versions

Files

Comments