Check the preview of 2nd version of this platform being developed by the open MLCommons taskforce on automation and reproducibility as a free, open-source and technology-agnostic on-prem platform.
Select experiment view:  
Dimensions Raw JSON files
# Platform Test Dataset Dataset file Successful
compile?		 Successful
run?		 Output
correct?		 Total test time
(sec.)		 Setup time
(sec.)		 Test time
(sec.)		 Environment All Features Flat
features		 Point UID Reproduce
1 Google (Google Compute Engine) caffe None False True False 2.867000 ± 0.9% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=40
CK_CAFFE_ITERATIONS=12
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-XOi8s1.prototxt
CK_CAFFE_MODEL_FILE=tmp-XOi8s1.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=4
 View View View 12dc64507f7429cb
2 Google (Google Compute Engine) caffe None False True False 0.602000 ± 11.6% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=8
CK_CAFFE_ITERATIONS=62
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-dYdlMB.prototxt
CK_CAFFE_MODEL_FILE=tmp-dYdlMB.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=2
 View View View 1f84c3796da24c5c
3 Google (Google Compute Engine) caffe None False True False 0.055000 ± 58.2% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=1
CK_CAFFE_ITERATIONS=500
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-bTCeEh.prototxt
CK_CAFFE_MODEL_FILE=tmp-bTCeEh.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=4
 View View View 23e88ffec7429874
4 Google (Google Compute Engine) caffe None False True False 4.559000 ± 1.7% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=64
CK_CAFFE_ITERATIONS=7
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-obvDV3.prototxt
CK_CAFFE_MODEL_FILE=tmp-obvDV3.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=4
 View View View 2496494838ce5939
5 Google (Google Compute Engine) caffe None False True False 4.846000 ± 5.3% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=64
CK_CAFFE_ITERATIONS=7
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-eYpvSc.prototxt
CK_CAFFE_MODEL_FILE=tmp-eYpvSc.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=2
 View View View 29c83f05361359c4
6 Google (Google Compute Engine) caffe None False True False 3.009000 ± 6.4% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=40
CK_CAFFE_ITERATIONS=12
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-O0RVWL.prototxt
CK_CAFFE_MODEL_FILE=tmp-O0RVWL.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=2
 View View View 389aa6fae12ce356
7 Google (Google Compute Engine) caffe None False True False 1.743000 ± 0.6% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=24
CK_CAFFE_ITERATIONS=20
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-gjp8Nu.prototxt
CK_CAFFE_MODEL_FILE=tmp-gjp8Nu.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=4
 View View View 3c3645589be50836
8 Google (Google Compute Engine) caffe None False True False 1.253000 ± 3.1% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=16
CK_CAFFE_ITERATIONS=31
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-L01JNr.prototxt
CK_CAFFE_MODEL_FILE=tmp-L01JNr.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=2
 View View View 4c9eaf7dd1400de7
9 Google (Google Compute Engine) caffe None False True False 4.015000 ± 2.2% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=56
CK_CAFFE_ITERATIONS=8
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-fggNrq.prototxt
CK_CAFFE_MODEL_FILE=tmp-fggNrq.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=4
 View View View 5870065d0ebe4805
10 Google (Google Compute Engine) caffe None False True False 2.295000 ± 1.0% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=32
CK_CAFFE_ITERATIONS=15
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-aqlUxq.prototxt
CK_CAFFE_MODEL_FILE=tmp-aqlUxq.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=4
 View View View 5b3e0c6b9d04271b
11 Google (Google Compute Engine) caffe None False True False 1.156000 ± 2.1% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=16
CK_CAFFE_ITERATIONS=31
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-a47lDr.prototxt
CK_CAFFE_MODEL_FILE=tmp-a47lDr.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=4
 View View View 6aa85bfedeeb5754
12 Google (Google Compute Engine) caffe None False True False 4.315000 ± 4.7% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=56
CK_CAFFE_ITERATIONS=8
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-Dw71ZW.prototxt
CK_CAFFE_MODEL_FILE=tmp-Dw71ZW.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=2
 View View View 95cf49ddaa94ef37
13 Google (Google Compute Engine) caffe None False True False 1.905000 ± 2.0% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=24
CK_CAFFE_ITERATIONS=20
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-tNMOrl.prototxt
CK_CAFFE_MODEL_FILE=tmp-tNMOrl.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=2
 View View View af361ca29441d8a9
14 Google (Google Compute Engine) caffe None False True False 0.085000 ± 23.5% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=1
CK_CAFFE_ITERATIONS=500
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-nyd5AL.prototxt
CK_CAFFE_MODEL_FILE=tmp-nyd5AL.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=2
 View View View bc742bda3a17315f
15 Google (Google Compute Engine) caffe None False True False 3.800000 ± 4.9% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=48
CK_CAFFE_ITERATIONS=10
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-uKEBGl.prototxt
CK_CAFFE_MODEL_FILE=tmp-uKEBGl.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=2
 View View View c798b7aea8797541
16 Google (Google Compute Engine) caffe None False True False 0.588000 ± 2.0% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=8
CK_CAFFE_ITERATIONS=62
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-vuErPO.prototxt
CK_CAFFE_MODEL_FILE=tmp-vuErPO.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=4
 View View View ce33d23f74dbc9ed
17 Google (Google Compute Engine) caffe None False True False 3.439000 ± 1.2% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=48
CK_CAFFE_ITERATIONS=10
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-lBJMnb.prototxt
CK_CAFFE_MODEL_FILE=tmp-lBJMnb.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=4
 View View View d8f9ba4184a3bb27
18 Google (Google Compute Engine) caffe None False True False 2.452000 ± 6.9% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=32
CK_CAFFE_ITERATIONS=15
CK_CAFFE_MODEL=/home/gfursin/CK/ck-caffe/program/caffe/tmp/tmp-VsKaZO.prototxt
CK_CAFFE_MODEL_FILE=tmp-VsKaZO.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/gfursin/CK-TOOLS/caffemodel-resnet50-intel-i8/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=2
 View View View f43c386708a28eff