Compare commits

Home / Compare 7f500540 .. bb08fb38

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.571-35.574=-0.003
σ0.053-0.055=-0.002
min35.539-35.542=-0.003
max35.722-35.729=-0.007
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.082-0.086=-0.003
σ0.005-0.004=0.002
min0.076-0.083=-0.006
max0.092-0.093=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.001-24.002=-0.001
σ0.001-0.003=-0.001
min23.999-23.999=0.000
max24.004-24.009=-0.005
mean413.000-414.900=-1.900
σ0.000-0.316=-0.316
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.068-0.069=-0.000
σ0.003-0.003=0.000
min0.066-0.066=-0.000
max0.074-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.560-1756.503=-37.942
σ169.716-0.364=169.352
min997.520-1755.929=-758.409
max1757.071-1757.087=-0.016
mean1606.300-1654.850=-48.550
σ610.472-640.957=-30.485
min625.000-629.000=-4.000
max2773.000-2843.000=-70.000
mean2.320-2.371=-0.052
σ0.251-0.133=0.117
min1.392-2.269=-0.877
max2.801-2.784=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.725-324.734=-0.009
σ0.037-0.056=-0.019
min324.659-324.635=0.024
max324.751-324.770=-0.019
mean2773.000-2843.000=-70.000
σ0.000
min2773.000-2843.000=-70.000
max2773.000-2843.000=-70.000
mean0.425-0.429=-0.004
σ0.002-0.007=-0.005
min0.423-0.422=0.001
max0.428-0.440=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1985.285-1985.292=-0.007
σ0.008-0.019=-0.011
min1985.273-1985.258=0.015
max1985.293-1985.305=-0.012
mean2773.000-2843.000=-70.000
σ0.000
min2773.000-2843.000=-70.000
max2773.000-2843.000=-70.000
mean2.629-2.667=-0.038
σ0.098-0.131=-0.032
min2.551-2.516=0.036
max2.764-2.844=-0.080
iters=5
new-facts=6402
prior-facts=1
mean4808.777-4808.789=-0.012
σ7.442-7.452=-0.010
min4805.412-4805.427=-0.016
max4822.090-4822.120=-0.030
mean2773.000-2843.000=-70.000
σ0.000
min2773.000-2843.000=-70.000
max2773.000-2843.000=-70.000
mean8.977-8.923=0.054
σ0.119-0.113=0.006
min8.828-8.774=0.054
max9.126-9.088=0.037
iters=5
new-facts=6402
prior-facts=6402
mean4996.485-4996.490=-0.006
σ0.022-0.018=0.005
min4996.460-4996.473=-0.013
max4996.510-4996.519=-0.009
mean3033.600-3066.000=-32.400
σ203.962-299.803=-95.842
min2773.000-2843.000=-70.000
max3309.000-3533.000=-224.000
mean8.627-8.587=0.040
σ0.140-0.122=0.018
min8.485-8.524=-0.039
max8.786-8.805=-0.020

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.974-1.013=-0.039
σ0.067-0.068=-0.000
min0.913-0.931=-0.018
max1.050-1.066=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.953-462.978=-0.025
σ574.255-574.252=0.002
min175.813-175.839=-0.026
max1324.335-1324.357=-0.022
mean86.250
σ8.500
min82.000
max99.000
mean2773.000-2843.000=-70.000
σ0.000
min2773.000-2843.000=-70.000
max2773.000-2843.000=-70.000
mean0.429-0.432=-0.003
σ0.307-0.300=0.006
min0.266-0.280=-0.014
max0.889-0.882=0.007
policies=20
mean1758.483-1758.723=-0.240
σ0.348-0.344=0.004
min1758.249-1758.495=-0.247
max1758.999-1759.232=-0.234
mean820.000
σ0.000
min820.000
max820.000
mean2773.000-2843.000=-70.000
σ0.000
min2773.000-2843.000=-70.000
max2773.000-2843.000=-70.000
mean2.793-2.798=-0.005
σ0.006-0.015=-0.008
min2.785-2.785=-0.000
max2.799-2.818=-0.019
policies=200
mean17591.820-17594.229=-2.409
σ0.412-0.579=-0.167
min17591.513-17593.688=-2.175
max17592.428-17595.043=-2.615
mean8200.000
σ0.000
min8200.000
max8200.000
mean2773.000-2843.000=-70.000
σ0.000
min2773.000-2843.000=-70.000
max2773.000-2843.000=-70.000
mean27.694-27.942=-0.247
σ0.376-0.347=0.028
min27.443-27.598=-0.155
max28.253-28.270=-0.017