Compare commits

Home / Compare c5009372 .. 20ef0d9f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=-0.001
σ0.047-0.049=-0.002
min33.948-33.951=-0.003
max34.107-34.113=-0.007
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.084-0.083=0.002
σ0.005-0.005=-0.000
min0.077-0.077=-0.000
max0.094-0.093=0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.001
σ0.003-0.002=0.000
min23.314-23.312=0.002
max23.322-23.321=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.065=0.000
σ0.003-0.003=0.000
min0.064-0.063=0.000
max0.073-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1757.299=0.002
σ0.363-0.362=0.001
min1756.727-1756.728=-0.001
max1757.895-1757.886=0.009
mean1660.650-1659.000=1.650
σ622.492-621.202=1.290
min668.000
max2593.000-2591.000=2.000
mean2.388-2.380=0.008
σ0.189-0.161=0.028
min2.124-2.229=-0.105
max2.874-2.908=-0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.441-326.438=0.004
σ0.060-0.059=0.002
min326.334-326.333=0.002
max326.478-326.467=0.012
mean2593.000-2591.000=2.000
σ0.000
min2593.000-2591.000=2.000
max2593.000-2591.000=2.000
mean0.436-0.426=0.010
σ0.010-0.006=0.004
min0.426-0.422=0.004
max0.446-0.437=0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.608-1988.618=-0.010
σ0.010-0.008=0.003
min1988.591-1988.604=-0.014
max1988.617-1988.623=-0.006
mean2593.000-2591.000=2.000
σ0.000
min2593.000-2591.000=2.000
max2593.000-2591.000=2.000
mean2.690-2.602=0.088
σ0.114-0.163=-0.048
min2.568-2.399=0.170
max2.865-2.768=0.096
iters=5
new-facts=6402
prior-facts=1
mean4813.499-4813.347=0.152
σ7.749-7.795=-0.046
min4809.895-4809.381=0.514
max4827.360-4827.283=0.077
mean2593.000-2591.000=2.000
σ0.000
min2593.000-2591.000=2.000
max2593.000-2591.000=2.000
mean8.780-9.065=-0.285
σ0.684-0.296=0.388
min7.717-8.835=-1.118
max9.481-9.523=-0.042
iters=5
new-facts=6402
prior-facts=6402
mean5000.937-5000.874=0.063
σ0.158-0.181=-0.023
min5000.657-5000.633=0.024
max5001.030-5001.016=0.014
mean2932.000-2976.200=-44.200
σ357.472-280.779=76.693
min2593.000-2591.000=2.000
max3455.000-3312.000=143.000
mean9.715-9.790=-0.075
σ0.242-0.290=-0.048
min9.364-9.421=-0.058
max10.045-10.224=-0.179

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.254-1.331=-0.077
σ0.339-0.297=0.042
min0.952-1.052=-0.100
max1.748-1.694=0.053

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.439-464.431=0.008
σ574.791-574.780=0.010
min177.038-177.037=0.001
max1326.625-1326.602=0.023
mean88.250
σ8.500
min84.000
max101.000
mean2593.000-2591.000=2.000
σ0.000
min2593.000-2591.000=2.000
max2593.000-2591.000=2.000
mean0.576-0.548=0.028
σ0.597-0.538=0.059
min0.273-0.278=-0.005
max1.472-1.355=0.117
policies=20
mean1770.731-1770.734=-0.003
σ0.354-0.360=-0.006
min1770.493-1770.494=-0.001
max1771.257-1771.268=-0.011
mean840.000
σ0.000
min840.000
max840.000
mean2593.000-2591.000=2.000
σ0.000
min2593.000-2591.000=2.000
max2593.000-2591.000=2.000
mean2.709-2.731=-0.022
σ0.013-0.015=-0.002
min2.696-2.710=-0.014
max2.723-2.745=-0.021
policies=200
mean17714.890-17714.916=-0.025
σ0.548-0.545=0.003
min17714.457-17714.593=-0.137
max17715.693-17715.727=-0.034
mean8400.000
σ0.000
min8400.000
max8400.000
mean2593.000-2591.000=2.000
σ0.000
min2593.000-2591.000=2.000
max2593.000-2591.000=2.000
mean27.496-27.534=-0.038
σ0.078-0.128=-0.051
min27.420-27.413=0.007
max27.579-27.674=-0.095