Compare commits

Home / Compare 4d489526 .. d2e327de

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.977=0.002
σ0.049-0.048=0.001
min33.953-33.949=0.004
max34.115-34.110=0.006
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.085-0.081=0.004
σ0.004-0.004=-0.001
min0.082-0.076=0.006
max0.091-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.001
σ0.001-0.003=-0.002
min23.315-23.309=0.006
max23.319-23.321=-0.002
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.063-0.060=0.003
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1757.304=-0.002
σ0.366-0.365=0.000
min1756.727-1756.728=-0.001
max1757.891-1757.893=-0.002
mean1663.550-1661.350=2.200
σ628.184-621.239=6.945
min668.000-670.000=-2.000
max2612.000-2593.000=19.000
mean2.356-2.344=0.012
σ0.109-0.105=0.004
min2.262-2.178=0.084
max2.725-2.692=0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.443-326.438=0.005
σ0.057-0.058=-0.000
min326.344-326.334=0.010
max326.490-326.465=0.024
mean2612.000-2593.000=19.000
σ0.000
min2612.000-2593.000=19.000
max2612.000-2593.000=19.000
mean0.431-0.427=0.004
σ0.012-0.006=0.007
min0.422-0.421=0.001
max0.445-0.435=0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.614-1988.600=0.014
σ0.013-0.016=-0.003
min1988.592-1988.580=0.012
max1988.625-1988.620=0.005
mean2612.000-2593.000=19.000
σ0.000
min2612.000-2593.000=19.000
max2612.000-2593.000=19.000
mean2.733-2.696=0.038
σ0.105-0.054=0.051
min2.643-2.644=-0.001
max2.911-2.772=0.139
iters=5
new-facts=6402
prior-facts=1
mean4813.331-4813.464=-0.134
σ7.793-7.738=0.055
min4809.464-4809.983=-0.519
max4827.266-4827.306=-0.041
mean2612.000-2593.000=19.000
σ0.000
min2612.000-2593.000=19.000
max2612.000-2593.000=19.000
mean8.670-8.993=-0.323
σ0.423-0.248=0.175
min7.940-8.630=-0.690
max8.984-9.278=-0.295
iters=5
new-facts=6402
prior-facts=6402
mean5001.020-5001.027=-0.007
σ0.028-0.034=-0.006
min5000.973-5000.984=-0.010
max5001.044-5001.076=-0.031
mean2949.000-2943.800=5.200
σ260.604-259.551=1.053
min2612.000-2593.000=19.000
max3294.000-3282.000=12.000
mean9.943-10.111=-0.167
σ0.243-0.522=-0.278
min9.635-9.580=0.055
max10.254-10.893=-0.639

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.231-1.253=-0.022
σ0.368-0.348=0.021
min0.916-0.912=0.003
max1.715-1.630=0.086

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.441-464.432=0.009
σ574.788-574.786=0.003
min177.040-177.034=0.006
max1326.624-1326.610=0.013
mean88.250
σ8.500
min84.000
max101.000
mean2612.000-2593.000=19.000
σ0.000
min2612.000-2593.000=19.000
max2612.000-2593.000=19.000
mean0.569-0.554=0.015
σ0.587-0.552=0.035
min0.274-0.277=-0.003
max1.449-1.381=0.068
policies=20
mean1770.758-1770.757=0.001
σ0.351-0.357=-0.006
min1770.531-1770.509=0.022
max1771.280-1771.286=-0.006
mean840.000
σ0.000
min840.000
max840.000
mean2612.000-2593.000=19.000
σ0.000
min2612.000-2593.000=19.000
max2612.000-2593.000=19.000
mean2.722-2.724=-0.002
σ0.020-0.019=0.001
min2.695-2.697=-0.002
max2.741-2.739=0.003
policies=200
mean17714.793-17714.828=-0.035
σ0.604-0.398=0.206
min17714.447-17714.544=-0.097
max17715.698-17715.413=0.286
mean8400.000
σ0.000
min8400.000
max8400.000
mean2612.000-2593.000=19.000
σ0.000
min2612.000-2593.000=19.000
max2612.000-2593.000=19.000
mean27.511-27.524=-0.012
σ0.125-0.104=0.021
min27.400-27.369=0.031
max27.689-27.594=0.094