Check the preview of 2nd version of this platform being developed by the open MLCommons taskforce on automation and reproducibility as a free, open-source and technology-agnostic on-prem platform.
Select experiment view:  
Dimensions Raw JSON files
# Platform Test Dataset Dataset file Successful
compile?
Successful
run?
Output
correct?
Total test time
(sec.)
Setup time
(sec.)
Test time
(sec.)
Environment All Features Flat
features
Point UID Reproduce
1 SAMSUNG SM-G950U1 image-classification-tflite None True True False 43.574535 CK_BATCH_COUNT=500
CK_BATCH_SIZE=1
CK_CPU_FREQUENCY=max
CK_CROP_PERCENT=87.5
CK_ENV_DATASET_IMAGENET_VAL=/home/anton/CK_TOOLS/dataset-imagenet-ilsvrc2012-val-min
CK_ENV_TENSORFLOW_MODEL_MOBILENET_MULTIPLIER=0.5
CK_ENV_TENSORFLOW_MODEL_MOBILENET_RESOLUTION=192
CK_ENV_TENSORFLOW_MODEL_MOBILENET_VERSION=1
CK_GPU_FREQUENCY=max
CK_IMAGE_FILE CK_RECREATE_CACHE=NO
CK_RESULTS_DIR=predictions
CK_SILENT_MODE=YES
CK_SKIP_IMAGES=0
CK_SUBTRACT_MEAN=YES
CK_TMP_IMAGE_SIZE=0
RUN_OPT_BATCH_COUNT=500
RUN_OPT_BATCH_SIZE=1
RUN_OPT_GRAPH_FILE=mobilenet_v1_0.5_192.tflite
RUN_OPT_GRAPH_PATH=/home/anton/CK_TOOLS/tensorflowmodel-mobilenet-v1-0.50-192-2018_02_22-py/mobilenet_v1_0.5_192.tflite
RUN_OPT_IMAGE_DIR=preprocessed/192-0-87.5
RUN_OPT_IMAGE_LIST=image_list.txt
RUN_OPT_IMAGE_LIST_PATH=/home/anton/CK_REPOS/ck-tensorflow/program/image-classification-tflite/tmp/image_list.txt
RUN_OPT_IMAGE_SIZE=192
RUN_OPT_NORMALIZE_DATA=1
RUN_OPT_RESULT_DIR=predictions
RUN_OPT_SILENT_MODE=1
RUN_OPT_SUBTRACT_MEAN=1
View View View 34483e45814743bc