Compare commits

Home / Compare 436efee3 .. 83e21e2a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.048-0.050=-0.002
min33.945-33.953=-0.008
max34.110-34.119=-0.008
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.084-0.085=-0.001
σ0.003-0.003=0.000
min0.082-0.082=-0.000
max0.090-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.001
σ0.003-0.004=-0.001
min23.313-23.311=0.002
max23.320-23.323=-0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.064-0.063=0.000
σ0.003-0.004=-0.000
min0.059-0.060=-0.000
max0.068-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.430=-0.000
σ0.364-0.365=-0.000
min1756.854-1756.854=0.000
max1758.019-1758.018=0.001
mean1665.050-1649.700=15.350
σ624.964-623.992=0.972
min673.000-676.000=-3.000
max2606.000-2588.000=18.000
mean2.367-2.383=-0.016
σ0.098-0.124=-0.026
min2.250-2.264=-0.014
max2.671-2.672=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.570-326.579=-0.008
σ0.039-0.031=0.008
min326.503-326.525=-0.022
max326.603-326.603=-0.000
mean2606.000-2588.000=18.000
σ0.000
min2606.000-2588.000=18.000
max2606.000-2588.000=18.000
mean0.425-0.425=-0.001
σ0.003-0.007=-0.004
min0.421-0.421=0.001
max0.429-0.438=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.730-1988.749=-0.019
σ0.009-0.007=0.002
min1988.718-1988.738=-0.020
max1988.739-1988.755=-0.016
mean2606.000-2588.000=18.000
σ0.000
min2606.000-2588.000=18.000
max2606.000-2588.000=18.000
mean2.790-2.666=0.124
σ0.147-0.017=0.130
min2.671-2.645=0.026
max2.963-2.692=0.271
iters=5
new-facts=6402
prior-facts=1
mean4813.503-4813.394=0.109
σ7.763-7.848=-0.085
min4809.471-4809.658=-0.186
max4827.378-4827.429=-0.052
mean2606.000-2588.000=18.000
σ0.000
min2606.000-2588.000=18.000
max2606.000-2588.000=18.000
mean8.279-8.334=-0.055
σ0.515-0.624=-0.109
min7.818-7.756=0.062
max9.021-9.151=-0.130
iters=5
new-facts=6402
prior-facts=6402
mean5001.130-5001.143=-0.014
σ0.022-0.032=-0.010
min5001.101-5001.113=-0.012
max5001.156-5001.193=-0.038
mean2972.200-2980.000=-7.800
σ398.920-414.561=-15.641
min2606.000-2588.000=18.000
max3534.000-3562.000=-28.000
mean9.785-9.774=0.011
σ0.211-0.388=-0.176
min9.446-9.268=0.178
max10.024-10.295=-0.270

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.260-1.298=-0.038
σ0.411-0.302=0.110
min0.919-1.047=-0.128
max1.806-1.781=0.025

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.569-464.564=0.005
σ574.791-574.778=0.013
min177.168-177.170=-0.002
max1326.755-1326.731=0.024
mean88.250
σ8.500
min84.000
max101.000
mean2606.000-2588.000=18.000
σ0.000
min2606.000-2588.000=18.000
max2606.000-2588.000=18.000
mean0.548-0.557=-0.009
σ0.556-0.566=-0.010
min0.262-0.269=-0.007
max1.382-1.406=-0.024
policies=20
mean1772.017-1772.027=-0.010
σ0.363-0.357=0.007
min1771.778-1771.777=0.001
max1772.557-1772.555=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2606.000-2588.000=18.000
σ0.000
min2606.000-2588.000=18.000
max2606.000-2588.000=18.000
mean2.727-2.717=0.010
σ0.017-0.026=-0.009
min2.707-2.694=0.014
max2.745-2.754=-0.009
policies=200
mean17727.422-17727.613=-0.191
σ0.397-0.514=-0.117
min17727.198-17727.342=-0.144
max17728.017-17728.383=-0.366
mean8400.000
σ0.000
min8400.000
max8400.000
mean2606.000-2588.000=18.000
σ0.000
min2606.000-2588.000=18.000
max2606.000-2588.000=18.000
mean27.571-27.527=0.043
σ0.113-0.164=-0.051
min27.463-27.376=0.088
max27.672-27.710=-0.037