Check the preview of 2nd version of this platform being developed by the open MLCommons taskforce on automation and reproducibility as a free, open-source and technology-agnostic on-prem platform.
Select experiment view:  
Dimensions Raw JSON files
# Platform Test Dataset Dataset file Successful
compile?
Successful
run?
Output
correct?
Total test time
(sec.)
Setup time
(sec.)
Test time
(sec.)
Environment All Features Flat
features
Point UID Reproduce
1 Rockchip (Rockchip RK3399 Firefly Board (Linux Opensource)) depthwiseconv-armcl-opencl tensor-depthwiseconv-synthetic-0001 shape-1-6-6-1-0 True True True 0.220864 ± 3.9% (10) 0.219710 ± 3.8% (10) 0.000909 ± 54.3% (10) CK_ABS_DIFF_THRESHOLD=0.001
CK_COMPUTE_DEVICE_ID=0
CK_COMPUTE_PLATFORM_ID=0
CK_CPU_FREQUENCY=max
CK_DATASET_FILENAME=shape-1-6-6-1-0
CK_DATA_LAYOUT=NHWC
CK_DEPTHWISE_3X3=0
CK_DEPTHWISE_PAD=0
CK_DEPTHWISE_STRIDE=1
CK_GPU_FREQUENCY=max
CK_IN_SHAPE_C=1
CK_IN_SHAPE_H=6
CK_IN_SHAPE_N=1
CK_IN_SHAPE_W=6
CK_LWS_TUNER_TYPE=NONE
CK_OUT_RAW_DATA=tmp-ck-output.bin
CK_PUSH_LIBS_TO_REMOTE=yes
CK_SEED=42
View View View 2a8f834e2e87c733
2 Rockchip (Rockchip RK3399 Firefly Board (Linux Opensource)) depthwiseconv-armcl-opencl tensor-depthwiseconv-synthetic-0001 shape-2-4-4-1-0 False True True 0.219057 ± 4.4% (10) 0.217918 ± 4.5% (10) 0.000912 ± 43.5% (10) CK_ABS_DIFF_THRESHOLD=0.001
CK_COMPUTE_DEVICE_ID=0
CK_COMPUTE_PLATFORM_ID=0
CK_CPU_FREQUENCY=max
CK_DATASET_FILENAME=shape-2-4-4-1-0
CK_DATA_LAYOUT=NHWC
CK_DEPTHWISE_3X3=0
CK_DEPTHWISE_PAD=0
CK_DEPTHWISE_STRIDE=1
CK_GPU_FREQUENCY=max
CK_IN_SHAPE_C=2
CK_IN_SHAPE_H=4
CK_IN_SHAPE_N=1
CK_IN_SHAPE_W=4
CK_LWS_TUNER_TYPE=NONE
CK_OUT_RAW_DATA=tmp-ck-output.bin
CK_PUSH_LIBS_TO_REMOTE=no
CK_SEED=42
View View View 422ca502dcd1c77e