Compare commits

Home / Compare d778002c .. cfe1d2b2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.048-0.048=0.000
min33.950-33.955=-0.005
max34.111-34.111=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.083-0.082=0.001
σ0.004-0.005=-0.002
min0.077-0.077=0.001
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.000
σ0.002-0.002=0.000
min23.315-23.314=0.001
max23.324-23.321=0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.063-0.065=-0.002
σ0.005-0.003=0.002
min0.059-0.064=-0.005
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.428=0.002
σ0.365-0.364=0.001
min1756.855-1756.854=0.001
max1758.019-1758.016=0.003
mean1646.950-1648.300=-1.350
σ625.876-612.222=13.654
min636.000-677.000=-41.000
max2837.000-2630.000=207.000
mean2.366-2.367=-0.000
σ0.087-0.093=-0.006
min2.264-2.255=0.009
max2.650-2.595=0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.571-326.575=-0.004
σ0.035-0.043=-0.008
min326.515-326.503=0.012
max326.607-326.616=-0.008
mean2837.000-2630.000=207.000
σ0.000
min2837.000-2630.000=207.000
max2837.000-2630.000=207.000
mean0.424-0.424=0.000
σ0.004-0.007=-0.003
min0.421-0.420=0.001
max0.431-0.436=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.732-1988.727=0.005
σ0.014-0.018=-0.004
min1988.719-1988.707=0.013
max1988.751-1988.749=0.002
mean2837.000-2630.000=207.000
σ0.000
min2837.000-2630.000=207.000
max2837.000-2630.000=207.000
mean2.723-2.803=-0.081
σ0.069-0.283=-0.214
min2.646-2.632=0.014
max2.803-3.305=-0.502
iters=5
new-facts=6402
prior-facts=1
mean4813.472-4813.458=0.014
σ7.472-7.778=-0.306
min4810.068-4809.613=0.455
max4826.838-4827.367=-0.529
mean2837.000-2630.000=207.000
σ0.000
min2837.000-2630.000=207.000
max2837.000-2630.000=207.000
mean8.616-8.985=-0.368
σ0.579-0.192=0.387
min7.809-8.674=-0.865
max9.191-9.173=0.018
iters=5
new-facts=6402
prior-facts=6402
mean5001.074-5001.146=-0.072
σ0.175-0.034=0.141
min5000.763-5001.112=-0.349
max5001.174-5001.200=-0.025
mean3035.000-2989.800=45.200
σ269.659-275.427=-5.768
min2837.000-2630.000=207.000
max3451.000-3317.000=134.000
mean9.775-9.752=0.022
σ0.174-0.388=-0.215
min9.635-9.113=0.522
max10.059-10.125=-0.066

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.118=-0.118
σ0.069-0.304=-0.235
min0.912-0.913=-0.001
max1.062-1.652=-0.591

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.571-464.571=0.001
σ574.766-574.780=-0.014
min177.175-177.172=0.003
max1326.720-1326.741=-0.021
mean88.250
σ8.500
min84.000
max101.000
mean2837.000-2630.000=207.000
σ0.000
min2837.000-2630.000=207.000
max2837.000-2630.000=207.000
mean0.437-0.556=-0.120
σ0.310-0.568=-0.258
min0.280-0.270=0.010
max0.902-1.409=-0.507
policies=20
mean1772.088-1772.012=0.076
σ0.366-0.353=0.013
min1771.829-1771.785=0.044
max1772.626-1772.538=0.088
mean840.000
σ0.000
min840.000
max840.000
mean2837.000-2630.000=207.000
σ0.000
min2837.000-2630.000=207.000
max2837.000-2630.000=207.000
mean2.792-2.728=0.064
σ0.021-0.018=0.003
min2.773-2.704=0.068
max2.819-2.747=0.072
policies=200
mean17727.667-17727.390=0.277
σ0.455-0.544=-0.089
min17727.341-17727.085=0.255
max17728.341-17728.205=0.136
mean8400.000
σ0.000
min8400.000
max8400.000
mean2837.000-2630.000=207.000
σ0.000
min2837.000-2630.000=207.000
max2837.000-2630.000=207.000
mean27.826-27.481=0.345
σ0.369-0.093=0.276
min27.476-27.390=0.087
max28.169-27.577=0.593