Compare commits

Home / Compare 6d5d821a .. 7f0949b0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.957=0.009
σ0.103-0.102=0.001
min35.922-35.915=0.007
max36.258-36.247=0.011
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.077-0.078=-0.001
σ0.004-0.004=-0.000
min0.075-0.075=-0.000
max0.085-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.204=0.004
σ0.005-0.004=0.001
min26.201-26.197=0.003
max26.217-26.209=0.008
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.061-0.063=-0.001
σ0.002-0.004=-0.001
min0.060-0.060=-0.000
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.307-1718.266=38.041
σ0.369-170.184=-169.815
min1755.731-995.238=760.494
max1756.901-1756.883=0.018
mean1656.200-1616.500=39.700
σ627.619-618.963=8.656
min609.000-618.000=-9.000
max2642.000-2673.000=-31.000
mean2.364-2.349=0.015
σ0.175-0.278=-0.103
min2.244-1.361=0.883
max3.058-2.873=0.185

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.826-278.818=0.008
σ0.004-0.019=-0.014
min278.821-278.785=0.036
max278.832-278.831=0.001
mean2642.000-2673.000=-31.000
σ0.000
min2642.000-2673.000=-31.000
max2642.000-2673.000=-31.000
mean0.409-0.412=-0.002
σ0.005-0.002=0.003
min0.405-0.410=-0.005
max0.417-0.415=0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.892-2268.886=0.006
σ0.013-0.015=-0.001
min2268.877-2268.875=0.002
max2268.914-2268.911=0.003
mean2642.000-2673.000=-31.000
σ0.000
min2642.000-2673.000=-31.000
max2642.000-2673.000=-31.000
mean2.995-3.146=-0.152
σ0.111-0.165=-0.055
min2.871-2.918=-0.047
max3.114-3.365=-0.251
iters=5
new-facts=6402
prior-facts=1
mean4954.264-4954.269=-0.005
σ0.804-0.951=-0.147
min4953.813-4953.694=0.119
max4955.697-4955.952=-0.255
mean2642.000-2673.000=-31.000
σ0.000
min2642.000-2673.000=-31.000
max2642.000-2673.000=-31.000
mean7.922-8.117=-0.195
σ0.137-0.347=-0.209
min7.828-7.837=-0.010
max8.161-8.608=-0.447
iters=5
new-facts=6402
prior-facts=6402
mean5168.795-5168.822=-0.027
σ0.076-0.090=-0.014
min5168.733-5168.719=0.014
max5168.881-5168.897=-0.016
mean3394.600-3447.400=-52.800
σ491.430-477.946=13.483
min2821.000-2890.000=-69.000
max4126.000-4139.000=-13.000
mean9.273-9.221=0.052
σ0.280-0.240=0.040
min8.908-9.015=-0.107
max9.668-9.597=0.070

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.157-0.947=0.210
σ0.403-0.010=0.393
min0.941-0.940=0.001
max1.872-0.964=0.908

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.350-460.350=-0.000
σ572.654-572.651=0.003
min174.013-174.015=-0.002
max1319.331-1319.326=0.004
mean79.500
σ7.000
min76.000
max90.000
mean2642.000-2673.000=-31.000
σ0.000
min2642.000-2673.000=-31.000
max2642.000-2673.000=-31.000
mean0.530-0.529=0.001
σ0.509-0.519=-0.010
min0.268-0.267=0.000
max1.293-1.307=-0.014
policies=20
mean1740.425-1740.423=0.002
σ0.319-0.322=-0.003
min1740.227-1740.227=0.000
max1740.901-1740.904=-0.003
mean760.000
σ0.000
min760.000
max760.000
mean2642.000-2673.000=-31.000
σ0.000
min2642.000-2673.000=-31.000
max2642.000-2673.000=-31.000
mean2.666-2.691=-0.025
σ0.015-0.010=0.005
min2.648-2.680=-0.033
max2.680-2.700=-0.021
policies=200
mean17411.411-17411.315=0.096
σ0.497-0.524=-0.027
min17411.077-17411.028=0.049
max17412.147-17412.100=0.047
mean7600.000
σ0.000
min7600.000
max7600.000
mean2642.000-2673.000=-31.000
σ0.000
min2642.000-2673.000=-31.000
max2642.000-2673.000=-31.000
mean26.930-27.017=-0.088
σ0.142-0.064=0.077
min26.775-26.928=-0.153
max27.114-27.075=0.038