Compare commits

Home / Compare a803e561 .. 4ce7243c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.770=-0.002
σ0.047-0.048=-0.002
min30.730-30.728=0.002
max30.897-30.903=-0.006
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.075-0.078=-0.002
σ0.004-0.003=0.001
min0.069-0.071=-0.002
max0.084-0.083=0.000
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=0.000
σ0.002-0.004=-0.002
min21.058-21.057=0.001
max21.063-21.069=-0.006
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.062-0.061=0.002
σ0.003-0.004=-0.001
min0.058-0.058=0.000
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean20813.754-20813.755=-0.001
σ0.353-0.354=-0.000
min20813.233-20813.240=-0.007
max20814.336-20814.336=-0.000
mean2588.950-2613.800=-24.850
σ730.037-729.420=0.617
min1418.000-1414.000=4.000
max3899.000-3908.000=-9.000
mean17.095-16.741=0.355
σ0.773-0.749=0.024
min16.059-15.840=0.219
max19.034-19.209=-0.175

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.736-300.747=-0.011
σ0.018-0.027=-0.009
min300.705-300.701=0.004
max300.751-300.770=-0.019
mean3899.000-3908.000=-9.000
σ0.000
min3899.000-3908.000=-9.000
max3899.000-3908.000=-9.000
mean0.429-0.438=-0.008
σ0.012-0.011=0.001
min0.418-0.427=-0.009
max0.445-0.452=-0.006
iters=5
new-facts=1
prior-facts=6402
mean3219.670-3219.725=-0.056
σ0.076-0.026=0.050
min3219.551-3219.686=-0.135
max3219.734-3219.748=-0.014
mean3899.000-3908.000=-9.000
σ0.000
min3899.000-3908.000=-9.000
max3899.000-3908.000=-9.000
mean3.712-3.989=-0.277
σ0.105-0.325=-0.220
min3.619-3.529=0.090
max3.865-4.301=-0.436
iters=5
new-facts=6402
prior-facts=1
mean6099.594-6099.757=-0.162
σ1.116-0.938=0.178
min6098.473-6099.266=-0.793
max6101.466-6101.431=0.035
mean3899.000-3908.000=-9.000
σ0.000
min3899.000-3908.000=-9.000
max3899.000-3908.000=-9.000
mean10.033-10.148=-0.115
σ0.831-0.318=0.513
min8.885-9.739=-0.854
max10.882-10.478=0.404
iters=5
new-facts=6402
prior-facts=6402
mean6248.762-6248.728=0.034
σ0.137-0.089=0.048
min6248.581-6248.572=0.009
max6248.963-6248.788=0.176
mean3913.800-3927.000=-13.200
σ33.094-42.485=-9.391
min3899.000-3908.000=-9.000
max3973.000-4003.000=-30.000
mean9.914-9.717=0.197
σ0.476-0.173=0.304
min9.505-9.453=0.052
max10.738-9.887=0.850

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.092-1.092=-0.000
σ0.145-0.177=-0.031
min0.960-0.953=0.007
max1.330-1.288=0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean529.949-529.951=-0.002
σ572.661-572.652=0.009
min243.618-243.613=0.005
max1388.941-1388.930=0.012
mean79.750
σ7.500
min76.000
max91.000
mean3899.000-3908.000=-9.000
σ0.000
min3899.000-3908.000=-9.000
max3899.000-3908.000=-9.000
mean0.660-0.658=0.002
σ0.572-0.573=-0.002
min0.367-0.355=0.012
max1.517-1.518=-0.000
policies=20
mean2436.594-2436.570=0.024
σ0.384-0.344=0.040
min2436.251-2436.264=-0.013
max2437.023-2436.970=0.053
mean760.000
σ0.000
min760.000
max760.000
mean3899.000-3908.000=-9.000
σ0.000
min3899.000-3908.000=-9.000
max3899.000-3908.000=-9.000
mean3.662-3.672=-0.011
σ0.020-0.016=0.005
min3.639-3.653=-0.013
max3.688-3.686=0.003
policies=200
mean24371.034-24370.979=0.056
σ0.486-0.366=0.120
min24370.712-24370.744=-0.031
max24371.758-24371.520=0.238
mean7600.000
σ0.000
min7600.000
max7600.000
mean3899.000-3908.000=-9.000
σ0.000
min3899.000-3908.000=-9.000
max3899.000-3908.000=-9.000
mean36.821-36.686=0.136
σ0.134-0.149=-0.015
min36.648-36.463=0.185
max36.928-36.771=0.157