Compare commits

Home / Compare fc371add .. 422c5df6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.975-33.980=-0.005
σ0.051-0.048=0.003
min33.946-33.952=-0.006
max34.118-34.111=0.007
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.070-0.083=-0.013
σ0.008-0.005=0.004
min0.059-0.077=-0.018
max0.085-0.090=-0.005
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.001
σ0.003-0.003=-0.001
min23.313-23.311=0.002
max23.322-23.325=-0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.061-0.064=-0.003
σ0.007-0.002=0.005
min0.051-0.059=-0.008
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.301=0.002
σ0.365-0.364=0.001
min1756.729-1756.726=0.003
max1757.889-1757.892=-0.003
mean1663.550-1655.300=8.250
σ627.323-618.147=9.176
min668.000-661.000=7.000
max2612.000-2588.000=24.000
mean2.368-2.397=-0.029
σ0.104-0.151=-0.047
min2.267-2.237=0.031
max2.655-2.710=-0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.419-326.455=-0.036
σ0.050-0.029=0.021
min326.331-326.405=-0.074
max326.450-326.477=-0.027
mean2612.000-2588.000=24.000
σ0.000
min2612.000-2588.000=24.000
max2612.000-2588.000=24.000
mean0.423-0.421=0.002
σ0.001-0.001=0.000
min0.421-0.420=0.002
max0.425-0.423=0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.610-1988.621=-0.011
σ0.006-0.003=0.003
min1988.605-1988.617=-0.012
max1988.620-1988.625=-0.005
mean2612.000-2588.000=24.000
σ0.000
min2612.000-2588.000=24.000
max2612.000-2588.000=24.000
mean2.759-2.637=0.122
σ0.145-0.129=0.016
min2.620-2.453=0.167
max2.973-2.805=0.168
iters=5
new-facts=6402
prior-facts=1
mean4813.271-4813.132=0.139
σ7.841-7.909=-0.068
min4809.443-4809.387=0.056
max4827.290-4827.266=0.025
mean2612.000-2588.000=24.000
σ0.000
min2612.000-2588.000=24.000
max2612.000-2588.000=24.000
mean8.337-8.570=-0.233
σ0.626-0.628=-0.003
min7.875-7.656=0.219
max9.296-9.308=-0.012
iters=5
new-facts=6402
prior-facts=6402
mean5000.862-5001.011=-0.149
σ0.183-0.024=0.160
min5000.657-5000.987=-0.330
max5001.026-5001.042=-0.016
mean2987.600-2989.400=-1.800
σ399.314-308.546=90.767
min2612.000-2588.000=24.000
max3552.000-3389.000=163.000
mean9.197-9.661=-0.464
σ0.615-0.169=0.445
min8.573-9.421=-0.849
max9.851-9.840=0.011

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.323-1.384=-0.061
σ0.351-0.294=0.057
min1.038-0.916=0.122
max1.869-1.715=0.155

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.430-464.431=-0.000
σ574.779-574.775=0.004
min177.039-177.037=0.002
max1326.599-1326.593=0.006
mean88.250
σ8.500
min84.000
max101.000
mean2612.000-2588.000=24.000
σ0.000
min2612.000-2588.000=24.000
max2612.000-2588.000=24.000
mean0.553-0.565=-0.012
σ0.558-0.583=-0.025
min0.267-0.272=-0.004
max1.389-1.439=-0.049
policies=20
mean1770.753-1770.757=-0.004
σ0.350-0.350=-0.000
min1770.521-1770.523=-0.002
max1771.273-1771.278=-0.005
mean840.000
σ0.000
min840.000
max840.000
mean2612.000-2588.000=24.000
σ0.000
min2612.000-2588.000=24.000
max2612.000-2588.000=24.000
mean2.728-2.712=0.016
σ0.010-0.007=0.003
min2.714-2.704=0.009
max2.738-2.719=0.018
policies=200
mean17714.929-17714.821=0.108
σ0.539-0.623=-0.084
min17714.648-17714.474=0.174
max17715.737-17715.752=-0.015
mean8400.000
σ0.000
min8400.000
max8400.000
mean2612.000-2588.000=24.000
σ0.000
min2612.000-2588.000=24.000
max2612.000-2588.000=24.000
mean27.406-27.494=-0.088
σ0.121-0.217=-0.095
min27.292-27.305=-0.013
max27.544-27.706=-0.162