Check the preview of 2nd version of this platform being developed by the open MLCommons taskforce on automation and reproducibility as a free, open-source and technology-agnostic on-prem platform.
Select experiment view:  
Dimensions Raw JSON files
# Platform Test Dataset Dataset file Successful
compile?
Successful
run?
Output
correct?
Total test time
(sec.)
Setup time
(sec.)
Test time
(sec.)
Environment All Features Flat
features
Point UID Reproduce
1 HUAWEI BLA-L09 image-classification-tflite None True True False 26.758680 CK_BATCH_COUNT=500
CK_BATCH_SIZE=1
CK_CPU_FREQUENCY=max
CK_CROP_PERCENT=87.5
CK_ENV_DATASET_IMAGENET_VAL=/home/anton/CK_TOOLS/dataset-imagenet-ilsvrc2012-val-min
CK_ENV_TENSORFLOW_MODEL_MOBILENET_MULTIPLIER=0.25
CK_ENV_TENSORFLOW_MODEL_MOBILENET_RESOLUTION=224
CK_ENV_TENSORFLOW_MODEL_MOBILENET_VERSION=1
CK_GPU_FREQUENCY=max
CK_IMAGE_FILE CK_RECREATE_CACHE=NO
CK_RESULTS_DIR=predictions
CK_SILENT_MODE=YES
CK_SKIP_IMAGES=0
CK_SUBTRACT_MEAN=YES
CK_TMP_IMAGE_SIZE=0
RUN_OPT_BATCH_COUNT=500
RUN_OPT_BATCH_SIZE=1
RUN_OPT_GRAPH_FILE=mobilenet_v1_0.25_224.tflite
RUN_OPT_GRAPH_PATH=/home/anton/CK_TOOLS/tensorflowmodel-mobilenet-v1-0.25-224-2018_02_22-py/mobilenet_v1_0.25_224.tflite
RUN_OPT_IMAGE_DIR=preprocessed/224-0-87.5
RUN_OPT_IMAGE_LIST=image_list.txt
RUN_OPT_IMAGE_LIST_PATH=/home/anton/CK_REPOS/ck-tensorflow/program/image-classification-tflite/tmp/image_list.txt
RUN_OPT_IMAGE_SIZE=224
RUN_OPT_NORMALIZE_DATA=1
RUN_OPT_RESULT_DIR=predictions
RUN_OPT_SILENT_MODE=1
RUN_OPT_SUBTRACT_MEAN=1
View View View ed4f0a9a9dd15604