Compare commits

Home / Compare 3f3461e7 .. c421b4ea

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-31.041=39.333
σ0.058-0.050=0.008
min70.336-31.004=39.332
max70.535-31.180=39.355
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.160-0.077=0.083
σ0.003-0.005=-0.001
min0.156-0.072=0.084
max0.165-0.084=0.081
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.002-0.002=0.001
min21.137-21.139=-0.003
max21.146-21.146=0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.062-0.062=-0.000
σ0.003-0.003=0.000
min0.058-0.059=-0.001
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.198-1751.412=0.786
σ0.362-0.363=-0.001
min1751.633-1750.839=0.794
max1752.787-1751.994=0.793
mean1676.950-1638.450=38.500
σ626.465-616.278=10.187
min669.000-632.000=37.000
max2622.000-2475.000=147.000
mean2.790-2.799=-0.009
σ0.154-0.128=0.026
min2.269-2.563=-0.293
max2.966-3.046=-0.079

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-266.760=3.172
σ0.007-0.008=-0.001
min269.925-266.751=3.174
max269.941-266.771=3.169
mean2622.000-2475.000=147.000
σ0.000
min2622.000-2475.000=147.000
max2622.000-2475.000=147.000
mean0.373-0.370=0.003
σ0.005-0.011=-0.006
min0.369-0.363=0.006
max0.382-0.389=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1930.390-1927.208=3.182
σ0.020-0.007=0.014
min1930.360-1927.199=3.161
max1930.409-1927.217=3.192
mean2622.000-2475.000=147.000
σ0.000
min2622.000-2475.000=147.000
max2622.000-2475.000=147.000
mean2.510-2.995=-0.486
σ0.068-0.089=-0.022
min2.457-2.877=-0.421
max2.611-3.128=-0.517
iters=5
new-facts=6402
prior-facts=1
mean4750.845-4747.627=3.218
σ0.830-0.850=-0.021
min4750.334-4746.849=3.485
max4752.312-4749.073=3.239
mean2622.000-2475.000=147.000
σ0.000
min2622.000-2475.000=147.000
max2622.000-2475.000=147.000
mean8.653-8.193=0.459
σ0.200-0.421=-0.222
min8.469-7.687=0.782
max8.868-8.685=0.183
iters=5
new-facts=6402
prior-facts=6402
mean4941.264-4938.167=3.097
σ0.202-0.082=0.120
min4940.926-4938.095=2.831
max4941.423-4938.265=3.158
mean2968.400-2950.400=18.000
σ263.754-413.733=-149.979
min2622.000-2475.000=147.000
max3316.000-3504.000=-188.000
mean8.456-8.438=0.017
σ0.157-0.236=-0.079
min8.291-8.262=0.029
max8.694-8.854=-0.161

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.287-1.719=-0.432
σ0.372-0.166=0.207
min0.939-1.463=-0.525
max1.823-1.870=-0.047

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.907-465.111=0.797
σ575.765-575.755=0.010
min178.021-177.230=0.791
max1329.555-1328.743=0.811
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2622.000-2475.000=147.000
σ0.000
min2622.000-2475.000=147.000
max2622.000-2475.000=147.000
mean0.568-0.550=0.018
σ0.562-0.543=0.019
min0.280-0.276=0.003
max1.411-1.364=0.047
policies=20
mean1780.429-1772.548=7.880
σ0.353-0.338=0.015
min1780.191-1772.321=7.870
max1780.951-1773.049=7.902
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2622.000-2475.000=147.000
σ0.000
min2622.000-2475.000=147.000
max2622.000-2475.000=147.000
mean2.787-2.750=0.037
σ0.020-0.046=-0.026
min2.758-2.707=0.050
max2.800-2.803=-0.003
policies=200
mean17811.251-17732.412=78.838
σ0.530-0.528=0.002
min17810.887-17732.043=78.844
max17812.036-17733.182=78.854
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2622.000-2475.000=147.000
σ0.000
min2622.000-2475.000=147.000
max2622.000-2475.000=147.000
mean27.916-27.643=0.273
σ0.118-0.129=-0.011
min27.807-27.558=0.249
max28.044-27.834=0.210