Compare commits

Home / Compare f34a9da5 .. 0b1a6d7f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.375=-0.001
σ0.058-0.058=-0.000
min70.337-70.334=0.003
max70.536-70.537=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.156-0.160=-0.004
σ0.005-0.004=0.001
min0.151-0.157=-0.006
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.001
σ0.003-0.003=-0.000
min21.139-21.139=0.001
max21.146-21.148=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.064=-0.000
σ0.002-0.003=-0.001
min0.062-0.062=-0.000
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.199=-0.000
σ0.361-0.360=0.000
min1751.637-1751.628=0.009
max1752.779-1752.795=-0.016
mean1640.900-1630.400=10.500
σ623.797-598.955=24.843
min667.000-646.000=21.000
max2503.000-2415.000=88.000
mean2.791-2.816=-0.026
σ0.155-0.119=0.036
min2.345-2.520=-0.175
max3.036-2.981=0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.914-269.906=0.008
σ0.007-0.010=-0.003
min269.904-269.894=0.010
max269.921-269.923=-0.001
mean2503.000-2415.000=88.000
σ0.000
min2503.000-2415.000=88.000
max2503.000-2415.000=88.000
mean0.375-0.373=0.002
σ0.006-0.004=0.002
min0.370-0.369=0.001
max0.386-0.380=0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.398-1930.385=0.013
σ0.007-0.018=-0.011
min1930.388-1930.364=0.024
max1930.406-1930.405=0.001
mean2503.000-2415.000=88.000
σ0.000
min2503.000-2415.000=88.000
max2503.000-2415.000=88.000
mean2.507-2.536=-0.029
σ0.072-0.152=-0.080
min2.450-2.394=0.056
max2.596-2.777=-0.180
iters=5
new-facts=6402
prior-facts=1
mean4750.857-4750.717=0.140
σ0.852-0.545=0.307
min4750.337-4750.329=0.008
max4752.371-4751.659=0.712
mean2503.000-2415.000=88.000
σ0.000
min2503.000-2415.000=88.000
max2503.000-2415.000=88.000
mean8.537-8.623=-0.086
σ0.580-0.270=0.311
min7.616-8.363=-0.747
max9.171-8.932=0.239
iters=5
new-facts=6402
prior-facts=6402
mean4941.331-4941.266=0.065
σ0.090-0.191=-0.101
min4941.255-4940.956=0.298
max4941.437-4941.425=0.012
mean3010.400-2958.000=52.400
σ308.992-274.170=34.822
min2584.000-2590.000=-6.000
max3301.000-3315.000=-14.000
mean8.569-8.559=0.011
σ0.136-0.332=-0.196
min8.362-8.351=0.010
max8.687-9.146=-0.459

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.729-1.807=-0.078
σ0.164-0.117=0.047
min1.472-1.635=-0.162
max1.902-1.937=-0.035

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.905-465.902=0.003
σ575.760-575.758=0.002
min178.023-178.020=0.003
max1329.545-1329.539=0.006
mean81.750
σ7.500
min78.000
max93.000
mean2503.000-2415.000=88.000
σ0.000
min2503.000-2415.000=88.000
max2503.000-2415.000=88.000
mean0.563-0.562=0.001
σ0.562-0.565=-0.002
min0.278-0.276=0.002
max1.407-1.409=-0.003
policies=20
mean1780.476-1780.461=0.014
σ0.359-0.361=-0.002
min1780.235-1780.221=0.013
max1781.008-1780.997=0.010
mean780.000
σ0.000
min780.000
max780.000
mean2503.000-2415.000=88.000
σ0.000
min2503.000-2415.000=88.000
max2503.000-2415.000=88.000
mean2.782-2.758=0.024
σ0.043-0.009=0.034
min2.748-2.746=0.002
max2.843-2.765=0.077
policies=200
mean17811.398-17811.533=-0.135
σ0.568-0.482=0.085
min17810.995-17811.258=-0.262
max17812.234-17812.255=-0.021
mean7800.000
σ0.000
min7800.000
max7800.000
mean2503.000-2415.000=88.000
σ0.000
min2503.000-2415.000=88.000
max2503.000-2415.000=88.000
mean27.808-27.736=0.072
σ0.105-0.187=-0.082
min27.691-27.634=0.058
max27.936-28.016=-0.080