Compare commits

Home / Compare fd623eab .. 62fe6bb7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=0.000
σ0.054-0.054=0.001
min70.751-70.753=-0.002
max70.935-70.934=0.002
mean424.800-415.000=9.800
σ0.422-0.000=0.422
min424.000-415.000=9.000
max425.000-415.000=10.000
mean0.160-0.160=-0.000
σ0.003-0.009=-0.006
min0.156-0.151=0.005
max0.165-0.185=-0.020
cache=y
dps=1
iters=10
policies=100
mean21.494-21.494=0.000
σ0.003-0.003=0.000
min21.490-21.488=0.002
max21.497-21.497=-0.000
mean425.000-415.000=10.000
σ0.000
min425.000-415.000=10.000
max425.000-415.000=10.000
mean0.065-0.063=0.002
σ0.003-0.003=0.000
min0.060-0.059=0.002
max0.073-0.067=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.881-1751.880=0.001
σ0.360-0.361=-0.001
min1751.315-1751.313=0.003
max1752.472-1752.464=0.008
mean1663.050-1654.850=8.200
σ626.759-626.534=0.226
min687.000-679.000=8.000
max2665.000-2660.000=5.000
mean2.825-2.840=-0.015
σ0.114-0.170=-0.056
min2.509-2.330=0.179
max3.017-3.045=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.379-269.378=0.001
σ0.006-0.005=0.000
min269.371-269.370=0.000
max269.387-269.384=0.003
mean2665.000-2660.000=5.000
σ0.000
min2665.000-2660.000=5.000
max2665.000-2660.000=5.000
mean0.375-0.376=-0.002
σ0.005-0.005=-0.000
min0.371-0.373=-0.002
max0.383-0.385=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1929.749-1929.752=-0.003
σ0.003-0.016=-0.013
min1929.746-1929.726=0.020
max1929.754-1929.770=-0.016
mean2665.000-2660.000=5.000
σ0.000
min2665.000-2660.000=5.000
max2665.000-2660.000=5.000
mean3.086-2.995=0.091
σ0.091-0.052=0.040
min3.013-2.918=0.095
max3.189-3.063=0.126
iters=5
new-facts=6402
prior-facts=1
mean4750.376-4750.541=-0.164
σ1.037-0.849=0.188
min4749.480-4750.094=-0.614
max4752.171-4752.054=0.117
mean2665.000-2660.000=5.000
σ0.000
min2665.000-2660.000=5.000
max2665.000-2660.000=5.000
mean8.656-8.358=0.298
σ0.503-0.426=0.077
min7.820-7.609=0.211
max9.066-8.626=0.440
iters=5
new-facts=6402
prior-facts=6402
mean4940.985-4940.982=0.004
σ0.012-0.018=-0.006
min4940.972-4940.957=0.015
max4940.999-4940.999=-0.001
mean3025.800-2981.200=44.600
σ296.361-256.888=39.473
min2665.000-2660.000=5.000
max3418.000-3335.000=83.000
mean8.564-8.435=0.129
σ0.140-0.085=0.056
min8.329-8.360=-0.031
max8.696-8.542=0.154

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.226=-0.013
σ0.381-0.254=0.127
min0.937-1.070=-0.133
max1.847-1.657=0.190

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.695-462.694=0.000
σ574.933-574.935=-0.001
min175.224-175.224=0.000
max1325.095-1325.096=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2665.000-2660.000=5.000
σ0.000
min2665.000-2660.000=5.000
max2665.000-2660.000=5.000
mean0.550-0.552=-0.002
σ0.553-0.551=0.003
min0.269-0.274=-0.005
max1.380-1.377=0.002
policies=20
mean1752.508-1752.514=-0.006
σ0.354-0.363=-0.009
min1752.291-1752.289=0.002
max1753.037-1753.055=-0.018
mean820.000
σ0.000
min820.000
max820.000
mean2665.000-2660.000=5.000
σ0.000
min2665.000-2660.000=5.000
max2665.000-2660.000=5.000
mean2.735-2.736=-0.001
σ0.014-0.009=0.005
min2.716-2.723=-0.007
max2.751-2.744=0.007
policies=200
mean17532.329-17532.328=0.001
σ0.519-0.463=0.057
min17532.040-17532.070=-0.030
max17533.107-17533.021=0.086
mean8200.000
σ0.000
min8200.000
max8200.000
mean2665.000-2660.000=5.000
σ0.000
min2665.000-2660.000=5.000
max2665.000-2660.000=5.000
mean27.405-27.497=-0.092
σ0.099-0.100=-0.000
min27.327-27.375=-0.049
max27.550-27.600=-0.051