Compare commits

Home / Compare 666950b3 .. 94a5b8dd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-70.376=0.000
σ0.058-0.056=0.002
min70.341-70.343=-0.002
max70.537-70.533=0.004
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.161-0.163=-0.002
σ0.003-0.003=0.001
min0.157-0.160=-0.004
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.003-0.003=0.000
min21.140-21.139=0.001
max21.148-21.147=0.001
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.063-0.065=-0.002
σ0.003-0.002=0.001
min0.060-0.062=-0.002
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.202=-0.002
σ0.362-0.361=0.001
min1751.625-1751.631=-0.006
max1752.784-1752.772=0.012
mean1651.900-1635.600=16.300
σ645.567-617.896=27.672
min629.000-644.000=-15.000
max2848.000-2472.000=376.000
mean2.862-2.813=0.049
σ0.110-0.210=-0.100
min2.674-2.142=0.532
max3.047-3.087=-0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.928-269.934=-0.007
σ0.007-0.006=0.002
min269.921-269.930=-0.009
max269.939-269.944=-0.005
mean2848.000-2472.000=376.000
σ0.000
min2848.000-2472.000=376.000
max2848.000-2472.000=376.000
mean0.370-0.383=-0.012
σ0.001-0.004=-0.003
min0.369-0.380=-0.010
max0.371-0.389=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1930.392-1930.394=-0.002
σ0.009-0.013=-0.004
min1930.382-1930.372=0.010
max1930.401-1930.408=-0.006
mean2848.000-2472.000=376.000
σ0.000
min2848.000-2472.000=376.000
max2848.000-2472.000=376.000
mean2.683-2.556=0.127
σ0.192-0.115=0.077
min2.486-2.442=0.044
max2.969-2.704=0.265
iters=5
new-facts=6402
prior-facts=1
mean4750.624-4750.791=-0.167
σ1.122-0.520=0.603
min4749.395-4750.471=-1.076
max4752.463-4751.715=0.748
mean2848.000-2472.000=376.000
σ0.000
min2848.000-2472.000=376.000
max2848.000-2472.000=376.000
mean8.813-8.191=0.622
σ0.405-0.548=-0.144
min8.210-7.622=0.588
max9.208-9.050=0.157
iters=5
new-facts=6402
prior-facts=6402
mean4941.334-4941.187=0.147
σ0.084-0.190=-0.106
min4941.258-4940.925=0.334
max4941.429-4941.411=0.018
mean3064.400-2932.000=132.400
σ230.727-390.017=-159.290
min2848.000-2495.000=353.000
max3306.000-3451.000=-145.000
mean8.781-8.441=0.340
σ0.462-0.123=0.339
min8.380-8.316=0.064
max9.576-8.647=0.929

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.098-1.788=-0.691
σ0.219-0.137=0.083
min0.938-1.633=-0.695
max1.473-1.957=-0.483

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.921-465.902=0.019
σ575.768-575.759=0.009
min178.025-178.019=0.006
max1329.573-1329.541=0.032
mean81.750
σ7.500
min78.000
max93.000
mean2848.000-2472.000=376.000
σ0.000
min2848.000-2472.000=376.000
max2848.000-2472.000=376.000
mean0.442-0.536=-0.094
σ0.307-0.508=-0.201
min0.286-0.281=0.006
max0.902-1.298=-0.396
policies=20
mean1780.515-1780.450=0.064
σ0.358-0.356=0.001
min1780.245-1780.211=0.033
max1781.036-1780.979=0.058
mean780.000
σ0.000
min780.000
max780.000
mean2848.000-2472.000=376.000
σ0.000
min2848.000-2472.000=376.000
max2848.000-2472.000=376.000
mean2.851-2.762=0.090
σ0.016-0.022=-0.006
min2.832-2.739=0.094
max2.867-2.782=0.085
policies=200
mean17811.484-17811.394=0.090
σ0.470-0.440=0.030
min17810.969-17811.085=-0.116
max17812.109-17812.040=0.069
mean7800.000
σ0.000
min7800.000
max7800.000
mean2848.000-2472.000=376.000
σ0.000
min2848.000-2472.000=376.000
max2848.000-2472.000=376.000
mean28.364-27.946=0.418
σ0.430-0.043=0.387
min27.904-27.888=0.016
max28.762-27.992=0.770