Compare commits

Home / Compare c7affa21 .. d9c4e696

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.374=0.001
σ0.059-0.056=0.003
min70.335-70.335=0.000
max70.539-70.531=0.008
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.158-0.160=-0.001
σ0.005-0.003=0.002
min0.150-0.156=-0.007
max0.166-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.000
σ0.002-0.002=-0.000
min21.140-21.139=0.001
max21.147-21.146=0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.065-0.066=-0.001
σ0.003-0.002=0.001
min0.063-0.064=-0.001
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.199=0.001
σ0.363-0.361=0.001
min1751.626-1751.630=-0.004
max1752.781-1752.786=-0.005
mean1653.950-1652.600=1.350
σ646.173-645.336=0.837
min630.000
max2848.000-2855.000=-7.000
mean2.842-2.777=0.064
σ0.172-0.206=-0.034
min2.316-2.186=0.130
max3.060-2.979=0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.934-269.918=0.016
σ0.008-0.011=-0.003
min269.924-269.903=0.021
max269.944-269.931=0.013
mean2848.000-2855.000=-7.000
σ0.000
min2848.000-2855.000=-7.000
max2848.000-2855.000=-7.000
mean0.372-0.374=-0.002
σ0.005-0.007=-0.002
min0.369-0.370=-0.001
max0.381-0.386=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.396-1930.399=-0.003
σ0.004-0.006=-0.002
min1930.389-1930.392=-0.003
max1930.399-1930.408=-0.009
mean2848.000-2855.000=-7.000
σ0.000
min2848.000-2855.000=-7.000
max2848.000-2855.000=-7.000
mean2.593-2.477=0.116
σ0.110-0.076=0.034
min2.488-2.360=0.129
max2.763-2.546=0.217
iters=5
new-facts=6402
prior-facts=1
mean4750.863-4750.916=-0.054
σ0.876-0.747=0.130
min4750.396-4750.545=-0.149
max4752.426-4752.250=0.176
mean2848.000-2855.000=-7.000
σ0.000
min2848.000-2855.000=-7.000
max2848.000-2855.000=-7.000
mean8.567-8.218=0.349
σ0.561-0.325=0.236
min7.658-7.739=-0.081
max9.053-8.503=0.550
iters=5
new-facts=6402
prior-facts=6402
mean4941.334-4941.263=0.071
σ0.077-0.125=-0.047
min4941.258-4941.076=0.182
max4941.425-4941.426=-0.002
mean3098.400-3045.800=52.600
σ268.277-195.782=72.495
min2848.000-2855.000=-7.000
max3380.000-3319.000=61.000
mean8.699-8.522=0.177
σ0.392-0.133=0.260
min8.393-8.377=0.016
max9.368-8.654=0.714

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.107-1.046=0.061
σ0.080-0.128=-0.048
min1.068-0.933=0.135
max1.250-1.247=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.913-465.912=0.001
σ575.764-575.756=0.008
min178.021-178.029=-0.007
max1329.558-1329.546=0.013
mean81.750
σ7.500
min78.000
max93.000
mean2848.000-2855.000=-7.000
σ0.000
min2848.000-2855.000=-7.000
max2848.000-2855.000=-7.000
mean0.444-0.444=0.000
σ0.305-0.308=-0.003
min0.291-0.285=0.006
max0.902-0.906=-0.005
policies=20
mean1780.511-1780.460=0.052
σ0.356-0.335=0.020
min1780.247-1780.241=0.007
max1781.029-1780.956=0.073
mean780.000
σ0.000
min780.000
max780.000
mean2848.000-2855.000=-7.000
σ0.000
min2848.000-2855.000=-7.000
max2848.000-2855.000=-7.000
mean2.852-2.837=0.015
σ0.007-0.011=-0.004
min2.844-2.827=0.018
max2.861-2.851=0.010
policies=200
mean17811.583-17811.286=0.296
σ0.458-0.542=-0.084
min17811.292-17810.962=0.329
max17812.263-17812.097=0.166
mean7800.000
σ0.000
min7800.000
max7800.000
mean2848.000-2855.000=-7.000
σ0.000
min2848.000-2855.000=-7.000
max2848.000-2855.000=-7.000
mean28.329-28.357=-0.027
σ0.546-0.441=0.105
min27.684-27.913=-0.230
max28.800-28.815=-0.015