Compare commits

Home / Compare a7f7574b .. c0c6e452

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.001
σ0.050-0.049=0.001
min35.575-35.587=-0.011
max35.755-35.755=0.000
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.085-0.085=-0.000
σ0.003-0.003=0.001
min0.082-0.082=-0.001
max0.092-0.089=0.003
cache=y
dps=1
iters=10
policies=100
mean24.046-24.046=-0.000
σ0.004-0.004=-0.000
min24.041-24.040=0.001
max24.054-24.053=0.001
mean413.000-412.700=0.300
σ0.000-0.483=-0.483
min413.000-412.000=1.000
max413.000
mean0.066-0.068=-0.002
σ0.004-0.003=0.001
min0.062-0.062=-0.001
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.063-1757.063=-0.000
σ0.364-0.366=-0.001
min1756.488-1756.492=-0.004
max1757.655-1757.655=-0.000
mean1648.400-1647.450=0.950
σ638.703-628.793=9.910
min635.000-636.000=-1.000
max2830.000-2835.000=-5.000
mean2.369-2.347=0.022
σ0.109-0.081=0.028
min2.250-2.248=0.002
max2.645-2.601=0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.888-325.889=-0.001
σ0.060-0.052=0.009
min325.781-325.799=-0.017
max325.924-325.927=-0.003
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean0.430-0.426=0.004
σ0.012-0.007=0.005
min0.424-0.419=0.005
max0.451-0.437=0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.061-1988.065=-0.004
σ0.016-0.010=0.006
min1988.039-1988.054=-0.015
max1988.074-1988.079=-0.006
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean2.635-2.650=-0.015
σ0.152-0.099=0.053
min2.408-2.563=-0.155
max2.823-2.816=0.007
iters=5
new-facts=6402
prior-facts=1
mean4811.745-4811.883=-0.138
σ7.815-7.711=0.104
min4807.748-4808.273=-0.526
max4825.714-4825.674=0.040
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean8.473-8.329=0.144
σ0.710-0.744=-0.035
min7.700-7.698=0.002
max9.296-9.231=0.065
iters=5
new-facts=6402
prior-facts=6402
mean4999.390-4999.169=0.221
σ0.043-0.202=-0.159
min4999.337-4998.998=0.339
max4999.450-4999.399=0.051
mean3039.400-3038.000=1.400
σ284.527-253.026=31.502
min2830.000-2835.000=-5.000
max3480.000-3412.000=68.000
mean9.626-9.695=-0.070
σ0.754-0.263=0.491
min8.519-9.270=-0.751
max10.524-9.987=0.537

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.976-0.921=0.055
σ0.067-0.012=0.055
min0.916-0.912=0.004
max1.051-0.942=0.109

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.265-464.263=0.002
σ574.774-574.772=0.001
min176.867-176.873=-0.006
max1326.426-1326.422=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean0.433-0.432=0.001
σ0.294-0.303=-0.009
min0.285-0.279=0.007
max0.874-0.887=-0.012
policies=20
mean1769.072-1769.073=-0.002
σ0.362-0.355=0.007
min1768.817-1768.844=-0.027
max1769.606-1769.600=0.005
mean840.000
σ0.000
min840.000
max840.000
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean2.816-2.801=0.015
σ0.012-0.004=0.008
min2.806-2.796=0.011
max2.832-2.803=0.029
policies=200
mean17697.476-17697.522=-0.046
σ0.560-0.537=0.022
min17697.091-17697.107=-0.016
max17698.302-17698.312=-0.010
mean8400.000
σ0.000
min8400.000
max8400.000
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean28.047-28.047=-0.000
σ0.420-0.321=0.100
min27.625-27.692=-0.067
max28.487-28.384=0.102