Check the preview of 2nd version of this platform being developed by the open MLCommons taskforce on automation and reproducibility as a free, open-source and technology-agnostic on-prem platform.
Select experiment view:  
Dimensions Raw JSON files
# Platform Test Dataset Dataset file Successful
compile?
Successful
run?
Output
correct?
Total test time
(sec.)
Setup time
(sec.)
Test time
(sec.)
Environment All Features Flat
features
Point UID Reproduce
1 Rockchip (Rockchip RK3399 Firefly Board (Linux Opensource)) mobilenets-armcl-opencl None True True False 0.146478 ± 1.3% (10) CK_BATCHES_DIR=../batches
CK_BATCH_COUNT=1
CK_BATCH_LIST=../batches
CK_BATCH_SIZE=1
CK_COMPUTE_DEVICE_ID=0
CK_COMPUTE_PLATFORM_ID=0
CK_CONVOLUTION_METHOD_HINT=0
CK_CPU_FREQUENCY=max
CK_ENV_DATASET_IMAGENET_VAL=/home/fursin/CK/local/env/6b7b8b5d320f99fa/
CK_ENV_MOBILENET_RESOLUTION=224
CK_ENV_MOBILENET_WIDTH_MULTIPLIER=1.0
CK_GPU_FREQUENCY=max
CK_IMAGE_FILE CK_IMAGE_LIST=../images
CK_PREPARE_ALWAYS=NO
CK_RESULTS_DIR=predictions
CK_SKIP_IMAGES=0
View View View 420f1d2b28004a6b
2 Rockchip (Rockchip RK3399 Firefly Board (Linux Opensource)) mobilenets-armcl-opencl None True True False 0.236880 ± 2.0% (10) CK_BATCHES_DIR=../batches
CK_BATCH_COUNT=1
CK_BATCH_LIST=../batches
CK_BATCH_SIZE=1
CK_COMPUTE_DEVICE_ID=0
CK_COMPUTE_PLATFORM_ID=0
CK_CONVOLUTION_METHOD_HINT=1
CK_CPU_FREQUENCY=max
CK_ENV_DATASET_IMAGENET_VAL=/home/fursin/CK/local/env/6b7b8b5d320f99fa/
CK_ENV_MOBILENET_RESOLUTION=224
CK_ENV_MOBILENET_WIDTH_MULTIPLIER=1.0
CK_GPU_FREQUENCY=max
CK_IMAGE_FILE CK_IMAGE_LIST=../images
CK_PREPARE_ALWAYS=NO
CK_RESULTS_DIR=predictions
CK_SKIP_IMAGES=0
View View View 4a84ae3bd5e839c4