Compare commits

Home / Compare b92681b5 .. eccdb107

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.373=-0.000
σ0.047-0.057=-0.010
min70.344-70.341=0.003
max70.504-70.531=-0.028
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.161-0.157=0.004
σ0.007-0.004=0.003
min0.153-0.150=0.002
max0.179-0.162=0.017
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.000
σ0.003-0.002=0.000
min21.140-21.138=0.002
max21.148-21.146=0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.062-0.063=-0.001
σ0.003-0.002=0.001
min0.058-0.057=0.001
max0.067-0.065=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.201=0.187
σ0.360-0.360=-0.000
min1751.818-1751.625=0.193
max1752.960-1752.766=0.194
mean1639.400-1648.800=-9.400
σ617.086-642.052=-24.966
min626.000-630.000=-4.000
max2474.000-2852.000=-378.000
mean2.830-2.804=0.025
σ0.125-0.152=-0.027
min2.572-2.334=0.238
max3.043-2.987=0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.133-269.928=0.205
σ0.004-0.010=-0.006
min270.127-269.912=0.215
max270.139-269.939=0.200
mean2474.000-2852.000=-378.000
σ0.000
min2474.000-2852.000=-378.000
max2474.000-2852.000=-378.000
mean0.386-0.372=0.014
σ0.005-0.007=-0.002
min0.382-0.368=0.014
max0.394-0.384=0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.585-1930.383=0.203
σ0.020-0.030=-0.010
min1930.559-1930.337=0.222
max1930.605-1930.405=0.200
mean2474.000-2852.000=-378.000
σ0.000
min2474.000-2852.000=-378.000
max2474.000-2852.000=-378.000
mean2.522-2.557=-0.035
σ0.122-0.087=0.034
min2.439-2.482=-0.042
max2.730-2.680=0.050
iters=5
new-facts=6402
prior-facts=1
mean4751.037-4750.825=0.212
σ0.892-0.829=0.064
min4750.209-4750.317=-0.108
max4752.560-4752.289=0.270
mean2474.000-2852.000=-378.000
σ0.000
min2474.000-2852.000=-378.000
max2474.000-2852.000=-378.000
mean8.067-8.695=-0.627
σ0.345-0.294=0.051
min7.718-8.369=-0.651
max8.621-8.975=-0.354
iters=5
new-facts=6402
prior-facts=6402
mean4941.523-4941.332=0.191
σ0.093-0.094=-0.001
min4941.448-4941.255=0.193
max4941.637-4941.435=0.201
mean2929.000-3020.000=-91.000
σ396.410-189.582=206.827
min2474.000-2852.000=-378.000
max3440.000-3314.000=126.000
mean8.377-8.583=-0.206
σ0.096-0.120=-0.025
min8.271-8.407=-0.137
max8.531-8.737=-0.206

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.760-1.091=0.669
σ0.189-0.110=0.079
min1.438-0.951=0.487
max1.923-1.261=0.662

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.358-465.922=0.436
σ575.927-575.770=0.158
min178.392-178.024=0.367
max1330.249-1329.576=0.673
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2474.000-2852.000=-378.000
σ0.000
min2474.000-2852.000=-378.000
max2474.000-2852.000=-378.000
mean0.555-0.443=0.113
σ0.562-0.310=0.252
min0.266-0.284=-0.018
max1.398-0.907=0.490
policies=20
mean1784.224-1780.516=3.708
σ0.358-0.349=0.009
min1784.000-1780.262=3.738
max1784.757-1781.024=3.734
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2474.000-2852.000=-378.000
σ0.000
min2474.000-2852.000=-378.000
max2474.000-2852.000=-378.000
mean2.776-2.879=-0.103
σ0.019-0.025=-0.006
min2.756-2.856=-0.100
max2.802-2.902=-0.100
policies=200
mean17848.879-17811.574=37.305
σ0.446-0.499=-0.053
min17848.624-17811.184=37.440
max17849.547-17812.305=37.242
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2474.000-2852.000=-378.000
σ0.000
min2474.000-2852.000=-378.000
max2474.000-2852.000=-378.000
mean27.910-28.388=-0.478
σ0.047-0.558=-0.511
min27.872-27.787=0.085
max27.978-28.902=-0.923