We are very excited to join forces with OctoML.ai!
Contact Grigori Fursin for more details!
SOTA: MLPerf inference benchmark v0.5 results snapshot (open, Research, Development, and Other) for collaborative validation
result:sota-mlperf-inference-results-v0.5-open-rdo (v1.0.0)
License: https://github.com/mlperf/policies/blob/master/TERMS%20OF%20USE.md
Creation date: 2019-11-07
Source: mlperf.org/inference-overview/#overview
cID: 4cd2850867df4241:8e45edab745c8867
Push data to this graph: docs , graph meta description
Don't hesitate to get in touch if you encounter any issues or would like to discuss this community project!
Creation date: 2019-11-07
Source: mlperf.org/inference-overview/#overview
cID: 4cd2850867df4241:8e45edab745c8867
Push data to this graph: docs , graph meta description
Benchmark results (accuracy): A_IC* - Top-1, A_OD* - mAP, A_NMT* - BLEU.
cK components: packages, software detection plugins.
Image Classification: IC1 - ImageNet, MobileNet-v1, IC2 - ImageNet, ResNet-50 v1.5.
Object detection: OD1 - COCO, SSD w/ MobileNet-v1, OD2 - COCO 1200x1200, SSD w/ ResNet-34.
Translation: NMT - WMT E-G, NMT.
Form Factor: FF_M - Mobile/Handheld, FF_D - Desktop/Workstation, FF_S - Server, FF_E - Edge/Embedded.
These are not official results but a snapshot to collaboratively reproduce results and add portable workflows!
MLPerf name and logo are trademarks. See www.mlperf.org for more information.
Reproduced paper: MLPerf Inference Benchmark
Related reusable solutions: 1 2 3 4 5 6 7
Files
- .cm/desc.json (3 bytes)
- .cm/info.json (577 bytes)
- .cm/meta.json (2435 bytes)
- .cm/updates.json (868 bytes)
- desc.json (4974 bytes)
- result-1.json (1421 bytes)
- result-10.json (1543 bytes)
- result-11.json (1559 bytes)
- result-12.json (1556 bytes)
- result-13.json (1540 bytes)
- result-14.json (1543 bytes)
- result-15.json (1531 bytes)
- result-2.json (1432 bytes)
- result-3.json (1433 bytes)
- result-4.json (1562 bytes)
- result-5.json (1541 bytes)
- result-6.json (1547 bytes)
- result-7.json (1551 bytes)
- result-8.json (1550 bytes)
- result-9.json (1538 bytes)