We have joined forces with OctoML.ai and MLCommons to develop the 2nd generation of the open-source CK technology!

SOTA: MLPerf inference benchmark v0.5 results snapshot (closed, Preview) for collaborative validation

result:sota-mlperf-inference-results-v0.5-closed-preview (v1.0.0)
License: https://github.com/mlperf/policies/blob/master/TERMS%20OF%20USE.md
Creation date: 2019-11-07
Source: mlperf.org/inference-overview/#overview
cID: 4cd2850867df4241:184e3ba2ee27cff5
Push data to this graph: docs , graph meta description
Don't hesitate to get in touch if you encounter any issues or would like to discuss this community project!
Please report if this CK component works: 1  or fails: 0 
Sign up to be notified when artifacts are shared or updated!
Live CK scoreboards are connected with portable CK workflows and adaptive containers to help the community participate in collaborative AI/ML/SW/HW benchmarking and DSE. See this paper and ACM TechTalk for more details.
Benchmark results: SS - Single Stream in milliseconds, MS - MultiStream in no. streams, S - Server in QPS, O - Offline in inputs/second.
cK components: packages, software detection plugins.
Image Classification: IC1 - ImageNet, MobileNet-v1, IC2 - ImageNet, ResNet-50 v1.5.
Object detection: OD1 - COCO, SSD w/ MobileNet-v1, OD2 - COCO 1200x1200, SSD w/ ResNet-34.
Translation: NMT - WMT E-G, NMT.
Form Factor: FF_M - Mobile/Handheld, FF_D - Desktop/Workstation, FF_S - Server, FF_E - Edge/Embedded.
These are not official results but a snapshot to collaboratively reproduce results and add portable workflows!
MLPerf name and logo are trademarks. See www.mlperf.org for more information.

Reproduced paper: MLPerf Inference Benchmark
Related reusable solutions:   1     2     3     4     5     6     7  

SOTA: MLPerf inference benchmark v0.5 results snapshot (closed, Preview) for collaborative validation




Please log in to add your comments!
If you notice any inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!