Compare commits

Home / Compare 3c1b1e4b .. 8404c660

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.049-0.049=-0.000
min33.937-33.942=-0.005
max34.115-34.117=-0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.084-0.084=-0.000
σ0.003-0.002=0.001
min0.081-0.082=-0.002
max0.090-0.089=0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.001
σ0.003-0.003=0.000
min23.314-23.315=-0.001
max23.324-23.324=0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.064=0.001
σ0.002-0.004=-0.002
min0.063-0.060=0.003
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.302=0.001
σ0.364-0.365=-0.001
min1756.727-1756.726=0.000
max1757.893-1757.886=0.007
mean1667.100-1648.050=19.050
σ626.211-630.487=-4.275
min666.000-636.000=30.000
max2613.000-2835.000=-222.000
mean2.370-2.369=0.001
σ0.161-0.087=0.075
min2.174-2.266=-0.092
max2.833-2.636=0.196

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.449-326.443=0.006
σ0.043-0.058=-0.015
min326.375-326.339=0.036
max326.485-326.477=0.007
mean2613.000-2835.000=-222.000
σ0.000
min2613.000-2835.000=-222.000
max2613.000-2835.000=-222.000
mean0.429-0.427=0.001
σ0.004-0.012=-0.008
min0.425-0.420=0.004
max0.435-0.449=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.616-1988.612=0.004
σ0.010-0.014=-0.004
min1988.600-1988.593=0.006
max1988.626-1988.627=-0.001
mean2613.000-2835.000=-222.000
σ0.000
min2613.000-2835.000=-222.000
max2613.000-2835.000=-222.000
mean2.687-2.728=-0.040
σ0.116-0.142=-0.026
min2.618-2.558=0.060
max2.895-2.879=0.016
iters=5
new-facts=6402
prior-facts=1
mean4813.348-4813.391=-0.043
σ7.702-7.763=-0.061
min4809.426-4809.610=-0.184
max4827.116-4827.273=-0.158
mean2613.000-2835.000=-222.000
σ0.000
min2613.000-2835.000=-222.000
max2613.000-2835.000=-222.000
mean8.577-8.212=0.365
σ0.379-0.572=-0.193
min8.271-7.609=0.662
max9.061-9.044=0.017
iters=5
new-facts=6402
prior-facts=6402
mean5000.940-5001.005=-0.065
σ0.166-0.035=0.131
min5000.644-5000.975=-0.330
max5001.035-5001.063=-0.028
mean3000.000-3035.800=-35.800
σ283.716-253.285=30.431
min2613.000-2835.000=-222.000
max3372.000-3411.000=-39.000
mean9.799-9.442=0.356
σ0.150-0.635=-0.485
min9.638-8.520=1.118
max10.001-10.229=-0.227

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.222-1.052=0.169
σ0.343-0.171=0.172
min0.922-0.917=0.006
max1.628-1.338=0.290

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.435-464.441=-0.006
σ574.785-574.770=0.015
min177.040-177.047=-0.006
max1326.613-1326.596=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2613.000-2835.000=-222.000
σ0.000
min2613.000-2835.000=-222.000
max2613.000-2835.000=-222.000
mean0.546-0.437=0.110
σ0.546-0.308=0.239
min0.269-0.282=-0.013
max1.366-0.898=0.468
policies=20
mean1770.748-1770.774=-0.027
σ0.358-0.362=-0.004
min1770.509-1770.525=-0.016
max1771.279-1771.310=-0.030
mean840.000
σ0.000
min840.000
max840.000
mean2613.000-2835.000=-222.000
σ0.000
min2613.000-2835.000=-222.000
max2613.000-2835.000=-222.000
mean2.719-2.776=-0.057
σ0.015-0.008=0.008
min2.702-2.766=-0.064
max2.735-2.785=-0.050
policies=200
mean17714.654-17714.699=-0.045
σ0.468-0.563=-0.095
min17714.333-17714.385=-0.053
max17715.348-17715.541=-0.194
mean8400.000
σ0.000
min8400.000
max8400.000
mean2613.000-2835.000=-222.000
σ0.000
min2613.000-2835.000=-222.000
max2613.000-2835.000=-222.000
mean27.324-27.852=-0.528
σ0.106-0.333=-0.228
min27.199-27.570=-0.371
max27.454-28.225=-0.771