Compare commits

Home / Compare 41b41eb8 .. 24f84f6d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.781=0.002
σ0.046-0.045=0.001
min70.748-70.751=-0.003
max70.909-70.905=0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.165-0.159=0.005
σ0.010-0.005=0.005
min0.158-0.151=0.007
max0.187-0.166=0.021
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.002-0.003=-0.001
min21.488-21.488=0.001
max21.495-21.497=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.063=0.001
σ0.003-0.004=-0.001
min0.060-0.058=0.002
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.094=-0.001
σ0.361-0.359=0.002
min1753.531-1753.536=-0.005
max1754.681-1754.674=0.007
mean1652.250-1638.400=13.850
σ611.833-617.915=-6.082
min645.000-642.000=3.000
max2476.000-2478.000=-2.000
mean2.832-2.809=0.023
σ0.150-0.140=0.009
min2.461-2.437=0.024
max3.141-3.025=0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.955=0.000
σ0.006-0.006=-0.000
min271.947-271.945=0.003
max271.963-271.962=0.002
mean2476.000-2478.000=-2.000
σ0.000
min2476.000-2478.000=-2.000
max2476.000-2478.000=-2.000
mean0.385-0.387=-0.002
σ0.007-0.014=-0.007
min0.381-0.378=0.002
max0.397-0.412=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1932.314-1932.327=-0.013
σ0.017-0.009=0.007
min1932.298-1932.316=-0.018
max1932.339-1932.337=0.002
mean2476.000-2478.000=-2.000
σ0.000
min2476.000-2478.000=-2.000
max2476.000-2478.000=-2.000
mean3.124-2.966=0.158
σ0.342-0.048=0.294
min2.895-2.904=-0.009
max3.729-3.012=0.716
iters=5
new-facts=6402
prior-facts=1
mean4753.107-4752.979=0.127
σ1.018-1.019=-0.001
min4752.543-4752.027=0.516
max4754.921-4754.714=0.207
mean2476.000-2478.000=-2.000
σ0.000
min2476.000-2478.000=-2.000
max2476.000-2478.000=-2.000
mean8.788-8.576=0.212
σ0.773-0.618=0.155
min7.898-7.585=0.313
max9.971-9.134=0.837
iters=5
new-facts=6402
prior-facts=6402
mean4943.561-4943.558=0.003
σ0.013-0.017=-0.003
min4943.546-4943.535=0.011
max4943.572-4943.575=-0.003
mean2954.200-3010.200=-56.000
σ268.344-294.684=-26.340
min2589.000-2606.000=-17.000
max3300.000-3381.000=-81.000
mean8.477-8.495=-0.019
σ0.062-0.102=-0.041
min8.372-8.379=-0.007
max8.529-8.593=-0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.591-1.797=-0.206
σ0.209-0.129=0.080
min1.344-1.573=-0.230
max1.806-1.893=-0.087

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.633-468.631=0.002
σ574.884-574.883=0.001
min181.188-181.185=0.003
max1330.959-1330.956=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2476.000-2478.000=-2.000
σ0.000
min2476.000-2478.000=-2.000
max2476.000-2478.000=-2.000
mean0.552-0.549=0.003
σ0.519-0.512=0.007
min0.287-0.289=-0.002
max1.331-1.317=0.014
policies=20
mean1812.208-1812.203=0.004
σ0.394-0.394=0.001
min1811.927-1811.945=-0.018
max1812.787-1812.784=0.003
mean840.000
σ0.000
min840.000
max840.000
mean2476.000-2478.000=-2.000
σ0.000
min2476.000-2478.000=-2.000
max2476.000-2478.000=-2.000
mean2.851-2.843=0.008
σ0.031-0.025=0.006
min2.822-2.818=0.004
max2.893-2.867=0.026
policies=200
mean18129.222-18129.056=0.165
σ0.455-0.588=-0.132
min18128.951-18128.664=0.287
max18129.899-18129.926=-0.027
mean8400.000
σ0.000
min8400.000
max8400.000
mean2476.000-2478.000=-2.000
σ0.000
min2476.000-2478.000=-2.000
max2476.000-2478.000=-2.000
mean28.702-28.722=-0.021
σ0.059-0.088=-0.029
min28.639-28.622=0.016
max28.781-28.800=-0.019