Compare commits

Home / Compare 3f250e68 .. 40a1c8c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.050-0.048=0.002
min33.951-33.950=0.001
max34.117-34.110=0.007
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.082-0.085=-0.002
σ0.005-0.004=0.001
min0.077-0.078=-0.001
max0.090-0.090=0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.000
σ0.003-0.002=0.001
min23.312-23.316=-0.003
max23.322-23.323=-0.001
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.065-0.065=0.000
σ0.004-0.003=0.001
min0.060-0.060=0.000
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.494=-0.000
σ0.364-0.366=-0.002
min1756.922-1756.919=0.002
max1758.083-1758.085=-0.002
mean1666.000-1644.350=21.650
σ641.590-625.152=16.438
min673.000-634.000=39.000
max2639.000-2833.000=-194.000
mean2.413-2.378=0.036
σ0.118-0.073=0.044
min2.290-2.268=0.022
max2.738-2.579=0.159

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.633-326.645=-0.012
σ0.050-0.045=0.005
min326.546-326.565=-0.019
max326.673-326.672=0.000
mean2639.000-2833.000=-194.000
σ0.000
min2639.000-2833.000=-194.000
max2639.000-2833.000=-194.000
mean0.424-0.424=0.001
σ0.002-0.001=0.001
min0.422-0.423=-0.001
max0.425-0.425=0.000
iters=5
new-facts=1
prior-facts=6402
mean1988.809-1988.806=0.003
σ0.003-0.007=-0.004
min1988.803-1988.795=0.009
max1988.811-1988.813=-0.002
mean2639.000-2833.000=-194.000
σ0.000
min2639.000-2833.000=-194.000
max2639.000-2833.000=-194.000
mean2.672-2.697=-0.025
σ0.056-0.102=-0.046
min2.615-2.604=0.011
max2.756-2.865=-0.110
iters=5
new-facts=6402
prior-facts=1
mean4813.572-4813.667=-0.095
σ7.756-7.684=0.072
min4809.828-4810.099=-0.271
max4827.442-4827.411=0.031
mean2639.000-2833.000=-194.000
σ0.000
min2639.000-2833.000=-194.000
max2639.000-2833.000=-194.000
mean8.705-8.639=0.066
σ0.658-0.487=0.172
min7.736-7.831=-0.095
max9.303-9.010=0.293
iters=5
new-facts=6402
prior-facts=6402
mean5001.068-5001.065=0.003
σ0.206-0.317=-0.111
min5000.828-5000.499=0.329
max5001.268-5001.232=0.036
mean3016.000-3062.400=-46.400
σ285.606-228.242=57.365
min2639.000-2833.000=-194.000
max3388.000-3398.000=-10.000
mean9.848-9.906=-0.059
σ0.268-0.083=0.184
min9.481-9.816=-0.335
max10.219-10.021=0.198

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.139-0.906=0.233
σ0.242-0.022=0.220
min0.939-0.887=0.052
max1.550-0.938=0.612

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.632-464.626=0.006
σ574.779-574.765=0.014
min177.240-177.238=0.003
max1326.801-1326.774=0.027
mean88.250
σ8.500
min84.000
max101.000
mean2639.000-2833.000=-194.000
σ0.000
min2639.000-2833.000=-194.000
max2639.000-2833.000=-194.000
mean0.556-0.436=0.119
σ0.576-0.302=0.274
min0.254-0.280=-0.025
max1.419-0.889=0.530
policies=20
mean1772.680-1772.693=-0.012
σ0.348-0.366=-0.018
min1772.445-1772.461=-0.016
max1773.197-1773.237=-0.040
mean840.000
σ0.000
min840.000
max840.000
mean2639.000-2833.000=-194.000
σ0.000
min2639.000-2833.000=-194.000
max2639.000-2833.000=-194.000
mean2.703-2.803=-0.100
σ0.011-0.012=-0.001
min2.689-2.791=-0.102
max2.713-2.818=-0.105
policies=200
mean17734.082-17734.041=0.041
σ0.529-0.520=0.010
min17733.750-17733.679=0.071
max17734.870-17734.812=0.058
mean8400.000
σ0.000
min8400.000
max8400.000
mean2639.000-2833.000=-194.000
σ0.000
min2639.000-2833.000=-194.000
max2639.000-2833.000=-194.000
mean27.583-28.087=-0.504
σ0.137-0.494=-0.357
min27.401-27.648=-0.247
max27.725-28.728=-1.003