Check the preview of 2nd version of this platform being developed by the open MLCommons taskforce on automation and reproducibility as a free, open-source and technology-agnostic on-prem platform.
Select experiment view:  
Dimensions Raw JSON files
# Platform Test Dataset Dataset file Successful
compile?		 Successful
run?		 Output
correct?		 Total test time
(sec.)		 Setup time
(sec.)		 Test time
(sec.)		 Environment All Features Flat
features		 Point UID Reproduce
1 Amazon EC2 (c5.9xlarge) caffe None False True False 16.094000 ± 1.7% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=48
CK_CAFFE_ITERATIONS=10
CK_CAFFE_MODEL=/home/ubuntu/CK/ck-caffe/program/caffe/tmp/tmp-cBUDi_.prototxt
CK_CAFFE_MODEL_FILE=tmp-cBUDi_.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_GPU_FREQUENCY=max
 View View View 14b6fb4a6f8b3ade
2 Amazon EC2 (c5.9xlarge) caffe None False True False 5.755000 ± 0.6% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=16
CK_CAFFE_ITERATIONS=31
CK_CAFFE_MODEL=/home/ubuntu/CK/ck-caffe/program/caffe/tmp/tmp-DveUdf.prototxt
CK_CAFFE_MODEL_FILE=tmp-DveUdf.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_GPU_FREQUENCY=max
 View View View 18cb843634887840
3 Amazon EC2 (c5.9xlarge) caffe None False True False 21.214000 ± 1.3% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=64
CK_CAFFE_ITERATIONS=7
CK_CAFFE_MODEL=/home/ubuntu/CK/ck-caffe/program/caffe/tmp/tmp-MFD2sN.prototxt
CK_CAFFE_MODEL_FILE=tmp-MFD2sN.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_GPU_FREQUENCY=max
 View View View 2bf3993a34c22962
4 Amazon EC2 (c5.9xlarge) caffe None False True False 18.620000 ± 0.9% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=56
CK_CAFFE_ITERATIONS=8
CK_CAFFE_MODEL=/home/ubuntu/CK/ck-caffe/program/caffe/tmp/tmp-jFve9c.prototxt
CK_CAFFE_MODEL_FILE=tmp-jFve9c.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_GPU_FREQUENCY=max
 View View View 5d4d4fa3920e367b
5 Amazon EC2 (c5.9xlarge) caffe None False True False 8.340000 ± 1.2% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=24
CK_CAFFE_ITERATIONS=20
CK_CAFFE_MODEL=/home/ubuntu/CK/ck-caffe/program/caffe/tmp/tmp-rOD4EU.prototxt
CK_CAFFE_MODEL_FILE=tmp-rOD4EU.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_GPU_FREQUENCY=max
 View View View 8d864481767405db
6 Amazon EC2 (c5.9xlarge) caffe None False True False 10.896000 ± 0.5% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=32
CK_CAFFE_ITERATIONS=15
CK_CAFFE_MODEL=/home/ubuntu/CK/ck-caffe/program/caffe/tmp/tmp-6XLGZ3.prototxt
CK_CAFFE_MODEL_FILE=tmp-6XLGZ3.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_GPU_FREQUENCY=max
 View View View b5fe6e644b398557
7 Amazon EC2 (c5.9xlarge) caffe None False True False 13.471000 ± 0.7% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=40
CK_CAFFE_ITERATIONS=12
CK_CAFFE_MODEL=/home/ubuntu/CK/ck-caffe/program/caffe/tmp/tmp-y2uIiU.prototxt
CK_CAFFE_MODEL_FILE=tmp-y2uIiU.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_GPU_FREQUENCY=max
 View View View df6a49425cf9ff06
8 Amazon EC2 (c5.9xlarge) caffe None False True False 0.841000 ± 1.5% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=1
CK_CAFFE_ITERATIONS=500
CK_CAFFE_MODEL=/home/ubuntu/CK/ck-caffe/program/caffe/tmp/tmp-voPrDv.prototxt
CK_CAFFE_MODEL_FILE=tmp-voPrDv.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_GPU_FREQUENCY=max
 View View View e99bec30b5ed2c4b
9 Amazon EC2 (c5.9xlarge) caffe None False True False 3.140000 ± 1.2% (5) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=8
CK_CAFFE_ITERATIONS=62
CK_CAFFE_MODEL=/home/ubuntu/CK/ck-caffe/program/caffe/tmp/tmp-bpvzfk.prototxt
CK_CAFFE_MODEL_FILE=tmp-bpvzfk.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/ubuntu/CK-TOOLS/caffemodel-inception-v3-fp32/inceptionv3.caffemodel
CK_GPU_FREQUENCY=max
 View View View f2b4c7599a9615c6