Check the preview of 2nd version of this platform being developed by the open MLCommons taskforce on automation and reproducibility as a free, open-source and technology-agnostic on-prem platform.
Select experiment view:  
Dimensions Raw JSON files
# Platform Test Dataset Dataset file Successful
compile?		 Successful
run?		 Output
correct?		 Total test time
(sec.)		 Setup time
(sec.)		 Test time
(sec.)		 Environment All Features Flat
features		 Point UID Reproduce
1 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 1.309000 ± 0.9% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=32
CK_CAFFE_ITERATIONS=15
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-xVQS9F.prototxt
CK_CAFFE_MODEL_FILE=tmp-xVQS9F.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=10
 View View View 14c46a4743f2fec3
2 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 1.627000 ± 0.7% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=40
CK_CAFFE_ITERATIONS=12
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-BJ7R5T.prototxt
CK_CAFFE_MODEL_FILE=tmp-BJ7R5T.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=20
 View View View 1b279d1f3d1463b7
3 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 2.207000 ± 9.2% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=56
CK_CAFFE_ITERATIONS=8
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-0KTvxw.prototxt
CK_CAFFE_MODEL_FILE=tmp-0KTvxw.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=10
 View View View 44bc97a857b4ed94
4 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 2.535000 ± 70.1% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=64
CK_CAFFE_ITERATIONS=7
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-Uqodm0.prototxt
CK_CAFFE_MODEL_FILE=tmp-Uqodm0.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=10
 View View View 45edb9f2dd7cc474
5 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 0.049000 ± 59.2% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=1
CK_CAFFE_ITERATIONS=500
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-ES2WBh.prototxt
CK_CAFFE_MODEL_FILE=tmp-ES2WBh.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=10
 View View View 4bb94c409d76f6cc
6 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 1.867000 ± 0.7% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=48
CK_CAFFE_ITERATIONS=10
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-HpyAax.prototxt
CK_CAFFE_MODEL_FILE=tmp-HpyAax.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=10
 View View View 4f12804ac99234d7
7 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 0.657000 ± 1.1% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=16
CK_CAFFE_ITERATIONS=31
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-tDJINz.prototxt
CK_CAFFE_MODEL_FILE=tmp-tDJINz.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=10
 View View View 4f898ba394cd9321
8 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 0.332000 ± 27.1% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=8
CK_CAFFE_ITERATIONS=62
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-6du9iF.prototxt
CK_CAFFE_MODEL_FILE=tmp-6du9iF.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=10
 View View View 524edb44cd486003
9 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 1.121000 ± 0.7% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=24
CK_CAFFE_ITERATIONS=20
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-uCKGAa.prototxt
CK_CAFFE_MODEL_FILE=tmp-uCKGAa.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=20
 View View View 5b48cf98183a98c1
10 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 1.546000 ± 72.0% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=40
CK_CAFFE_ITERATIONS=12
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-lSn92s.prototxt
CK_CAFFE_MODEL_FILE=tmp-lSn92s.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=10
 View View View 5f988b4075997a65
11 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 2.739000 ± 2.0% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=64
CK_CAFFE_ITERATIONS=7
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-6egXso.prototxt
CK_CAFFE_MODEL_FILE=tmp-6egXso.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=20
 View View View 6b05341f1a134939
12 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 0.705000 ± 1.7% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=16
CK_CAFFE_ITERATIONS=31
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-5odfIH.prototxt
CK_CAFFE_MODEL_FILE=tmp-5odfIH.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=20
 View View View 777343479a04a060
13 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 0.983000 ± 68.2% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=24
CK_CAFFE_ITERATIONS=20
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-3SRDot.prototxt
CK_CAFFE_MODEL_FILE=tmp-3SRDot.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=10
 View View View 8420e841e2f353b4
14 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 1.406000 ± 0.6% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=32
CK_CAFFE_ITERATIONS=15
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-Hfc7w5.prototxt
CK_CAFFE_MODEL_FILE=tmp-Hfc7w5.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=20
 View View View beb982c89e09cf2c
15 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 2.327000 ± 0.5% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=56
CK_CAFFE_ITERATIONS=8
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-_d6kwh.prototxt
CK_CAFFE_MODEL_FILE=tmp-_d6kwh.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=20
 View View View d2d57b4b5aa728c8
16 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 2.057000 ± 2.5% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=48
CK_CAFFE_ITERATIONS=10
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-coZeud.prototxt
CK_CAFFE_MODEL_FILE=tmp-coZeud.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=20
 View View View e44d08bb8911d56e
17 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 0.480000 ± 0.8% (None) CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=8
CK_CAFFE_ITERATIONS=62
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-gLb7lY.prototxt
CK_CAFFE_MODEL_FILE=tmp-gLb7lY.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=20
 View View View ed91e1d8cbf5df11
18 Hewlett-Packard (HP Z640 Workstation) caffe None False True False 0.091000 CAFFE_COMPUTE_DEVICE_ID=0
CK_CAFFE_BATCH_SIZE=1
CK_CAFFE_ITERATIONS=500
CK_CAFFE_MODEL=/home/fursin/CK/ck-caffe/program/caffe/tmp/tmp-i53Kwq.prototxt
CK_CAFFE_MODEL_FILE=tmp-i53Kwq.prototxt
CK_CAFFE_MODEL_MEAN_BIN=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet_mean.binaryproto
CK_CAFFE_MODEL_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_CPU_FREQUENCY=max
CK_ENV_MODEL_CAFFE_WEIGHTS=/home/fursin/CK/local/env/1a7c0379a2ca4184/ResNet-50-model.caffemodel
CK_GPU_FREQUENCY=max
OMP_NUM_THREADS=20
 View View View ffd87168c1846bbb