Compare commits

Home / Compare 442b7265 .. a803e561

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.762=0.008
σ0.048-0.057=-0.008
min30.728-30.736=-0.009
max30.903-30.922=-0.019
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.078-0.077=0.000
σ0.003-0.005=-0.002
min0.071-0.070=0.002
max0.083-0.086=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=0.000
σ0.004-0.003=0.001
min21.057-21.057=-0.000
max21.069-21.066=0.004
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.061-0.063=-0.002
σ0.004-0.002=0.001
min0.058-0.059=-0.001
max0.068-0.068=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean20813.755-20823.172=-9.417
σ0.354-0.356=-0.003
min20813.240-20822.639=-9.399
max20814.336-20823.752=-9.416
mean2613.800-2624.350=-10.550
σ729.420-753.295=-23.875
min1414.000-1466.000=-52.000
max3908.000-3813.000=95.000
mean16.741-17.022=-0.282
σ0.749-0.998=-0.249
min15.840-15.811=0.029
max19.209-19.209=0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.747-310.161=-9.414
σ0.027-0.040=-0.013
min300.701-310.090=-9.390
max300.770-310.186=-9.416
mean3908.000-3813.000=95.000
σ0.000
min3908.000-3813.000=95.000
max3908.000-3813.000=95.000
mean0.438-0.445=-0.007
σ0.011-0.011=0.000
min0.427-0.433=-0.006
max0.452-0.455=-0.003
iters=5
new-facts=1
prior-facts=6402
mean3219.725-3229.062=-9.336
σ0.026-0.055=-0.029
min3219.686-3229.017=-9.331
max3219.748-3229.155=-9.407
mean3908.000-3813.000=95.000
σ0.000
min3908.000-3813.000=95.000
max3908.000-3813.000=95.000
mean3.989-3.670=0.318
σ0.325-0.132=0.193
min3.529-3.545=-0.016
max4.301-3.871=0.430
iters=5
new-facts=6402
prior-facts=1
mean6099.757-6109.137=-9.380
σ0.938-1.024=-0.086
min6099.266-6108.448=-9.182
max6101.431-6110.946=-9.515
mean3908.000-3813.000=95.000
σ0.000
min3908.000-3813.000=95.000
max3908.000-3813.000=95.000
mean10.148-9.776=0.371
σ0.318-0.549=-0.230
min9.739-8.954=0.785
max10.478-10.356=0.122
iters=5
new-facts=6402
prior-facts=6402
mean6248.728-6258.183=-9.455
σ0.089-0.137=-0.048
min6248.572-6257.988=-9.416
max6248.788-6258.365=-9.577
mean3927.000-3813.000=114.000
σ42.485-0.000=42.485
min3908.000-3813.000=95.000
max4003.000-3813.000=190.000
mean9.717-9.719=-0.002
σ0.173-0.451=-0.278
min9.453-9.316=0.137
max9.887-10.363=-0.475

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.092-1.152=-0.059
σ0.177-0.265=-0.088
min0.953-0.939=0.014
max1.288-1.582=-0.294

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean529.951-539.360=-9.409
σ572.652-572.657=-0.005
min243.613-253.023=-9.411
max1388.930-1398.346=-9.416
mean79.750-81.750=-2.000
σ7.500
min76.000-78.000=-2.000
max91.000-93.000=-2.000
mean3908.000-3813.000=95.000
σ0.000
min3908.000-3813.000=95.000
max3908.000-3813.000=95.000
mean0.658-0.664=-0.006
σ0.573-0.518=0.055
min0.355-0.401=-0.046
max1.518-1.441=0.076
policies=20
mean2436.570-2530.749=-94.179
σ0.344-0.448=-0.103
min2436.264-2530.339=-94.075
max2436.970-2531.226=-94.256
mean760.000-780.000=-20.000
σ0.000
min760.000-780.000=-20.000
max760.000-780.000=-20.000
mean3908.000-3813.000=95.000
σ0.000
min3908.000-3813.000=95.000
max3908.000-3813.000=95.000
mean3.672-3.759=-0.087
σ0.016-0.011=0.004
min3.653-3.745=-0.092
max3.686-3.768=-0.082
policies=200
mean24370.979-25312.822=-941.843
σ0.366-0.514=-0.148
min24370.744-25312.553=-941.810
max24371.520-25313.592=-942.072
mean7600.000-7800.000=-200.000
σ0.000
min7600.000-7800.000=-200.000
max7600.000-7800.000=-200.000
mean3908.000-3813.000=95.000
σ0.000
min3908.000-3813.000=95.000
max3908.000-3813.000=95.000
mean36.686-37.761=-1.075
σ0.149-0.203=-0.053
min36.463-37.461=-0.998
max36.771-37.898=-1.127