Compare commits

Home / Compare 760625a9 .. ed5c20c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.050-0.048=0.003
min33.954-33.950=0.004
max34.120-34.110=0.010
mean414.000
σ0.000
min414.000
max414.000
mean0.085-0.085=0.000
σ0.003-0.003=0.000
min0.082-0.082=0.000
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.002-0.003=-0.001
min23.314-23.312=0.002
max23.319-23.320=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.001
min0.063-0.064=-0.000
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.427=0.001
σ0.364-0.364=0.000
min1756.854-1756.853=0.001
max1758.015-1758.013=0.002
mean1649.150-1665.700=-16.550
σ627.580-628.678=-1.099
min636.000-670.000=-34.000
max2823.000-2616.000=207.000
mean2.325-2.376=-0.051
σ0.082-0.106=-0.023
min2.238-2.279=-0.041
max2.556-2.716=-0.161

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.586-326.565=0.021
σ0.029-0.055=-0.027
min326.537-326.467=0.070
max326.608-326.597=0.011
mean2823.000-2616.000=207.000
σ0.000
min2823.000-2616.000=207.000
max2823.000-2616.000=207.000
mean0.422-0.424=-0.002
σ0.005-0.001=0.003
min0.419-0.422=-0.003
max0.431-0.426=0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.741-1988.737=0.004
σ0.006-0.007=-0.001
min1988.735-1988.726=0.009
max1988.751-1988.745=0.006
mean2823.000-2616.000=207.000
σ0.000
min2823.000-2616.000=207.000
max2823.000-2616.000=207.000
mean2.699-2.705=-0.006
σ0.076-0.041=0.035
min2.628-2.670=-0.043
max2.786-2.774=0.012
iters=5
new-facts=6402
prior-facts=1
mean4813.374-4813.619=-0.244
σ7.562-7.696=-0.134
min4809.578-4810.043=-0.465
max4826.894-4827.385=-0.490
mean2823.000-2616.000=207.000
σ0.000
min2823.000-2616.000=207.000
max2823.000-2616.000=207.000
mean8.818-8.251=0.567
σ0.390-0.516=-0.126
min8.283-7.725=0.558
max9.210-9.070=0.139
iters=5
new-facts=6402
prior-facts=6402
mean5001.147-5001.134=0.013
σ0.030-0.038=-0.008
min5001.113-5001.067=0.046
max5001.187-5001.162=0.025
mean3036.800-2943.000=93.800
σ199.371-359.059=-159.688
min2823.000-2616.000=207.000
max3322.000-3437.000=-115.000
mean9.797-9.779=0.018
σ0.253-0.252=0.001
min9.547-9.420=0.127
max10.217-10.134=0.084

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.940-1.196=-0.256
σ0.060-0.381=-0.321
min0.904-0.906=-0.002
max1.045-1.677=-0.632

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.562-464.564=-0.002
σ574.767-574.780=-0.013
min177.177-177.170=0.007
max1326.712-1326.734=-0.022
mean88.250
σ8.500
min84.000
max101.000
mean2823.000-2616.000=207.000
σ0.000
min2823.000-2616.000=207.000
max2823.000-2616.000=207.000
mean0.434-0.538=-0.105
σ0.304-0.524=-0.221
min0.278-0.276=0.002
max0.889-1.325=-0.436
policies=20
mean1772.045-1772.002=0.043
σ0.353-0.353=-0.000
min1771.811-1771.769=0.041
max1772.569-1772.526=0.043
mean840.000
σ0.000
min840.000
max840.000
mean2823.000-2616.000=207.000
σ0.000
min2823.000-2616.000=207.000
max2823.000-2616.000=207.000
mean2.776-2.743=0.033
σ0.007-0.044=-0.036
min2.770-2.711=0.059
max2.787-2.806=-0.020
policies=200
mean17727.652-17727.325=0.327
σ0.506-0.416=0.090
min17727.321-17727.014=0.307
max17728.399-17727.927=0.472
mean8400.000
σ0.000
min8400.000
max8400.000
mean2823.000-2616.000=207.000
σ0.000
min2823.000-2616.000=207.000
max2823.000-2616.000=207.000
mean27.875-27.467=0.408
σ0.441-0.109=0.332
min27.497-27.356=0.141
max28.389-27.561=0.828