Compare commits

Home / Compare 8dbfd282 .. bb804ec1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.972-35.974=-0.002
σ0.107-0.107=-0.000
min35.924-35.924=0.001
max36.275-36.277=-0.002
mean414.600-413.000=1.600
σ0.516-0.000=0.516
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.075-0.075=-0.001
σ0.004-0.005=-0.001
min0.070-0.071=-0.001
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.000
σ0.004-0.005=-0.000
min26.200-26.204=-0.003
max26.214-26.218=-0.004
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.061-0.061=-0.000
σ0.002-0.003=-0.000
min0.059-0.059=0.000
max0.068-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1758.364=-0.001
σ0.373-0.370=0.003
min1757.786-1757.787=-0.001
max1758.964-1758.960=0.004
mean1658.900-1655.450=3.450
σ622.005-620.149=1.856
min687.000-686.000=1.000
max2743.000-2746.000=-3.000
mean2.372-2.370=0.003
σ0.103-0.099=0.004
min2.269-2.264=0.005
max2.620-2.598=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.510-279.528=-0.018
σ0.007-0.005=0.002
min279.499-279.523=-0.024
max279.516-279.536=-0.019
mean2743.000-2746.000=-3.000
σ0.000
min2743.000-2746.000=-3.000
max2743.000-2746.000=-3.000
mean0.410-0.407=0.002
σ0.007-0.001=0.006
min0.401-0.405=-0.004
max0.419-0.408=0.011
iters=5
new-facts=1
prior-facts=6402
mean2178.442-2178.457=-0.015
σ0.012-0.012=-0.001
min2178.422-2178.439=-0.017
max2178.453-2178.474=-0.021
mean2743.000-2746.000=-3.000
σ0.000
min2743.000-2746.000=-3.000
max2743.000-2746.000=-3.000
mean3.318-3.370=-0.051
σ0.258-0.147=0.111
min2.998-3.200=-0.202
max3.718-3.556=0.162
iters=5
new-facts=6402
prior-facts=1
mean5056.382-5056.262=0.120
σ0.932-1.071=-0.139
min5055.880-5055.343=0.536
max5058.045-5058.119=-0.074
mean2743.000-2746.000=-3.000
σ0.000
min2743.000-2746.000=-3.000
max2743.000-2746.000=-3.000
mean8.481-8.644=-0.163
σ0.392-0.510=-0.118
min8.043-7.999=0.044
max9.021-9.360=-0.339
iters=5
new-facts=6402
prior-facts=6402
mean5193.660-5193.770=-0.110
σ0.134-0.089=0.046
min5193.490-5193.702=-0.212
max5193.848-5193.872=-0.024
mean3232.600-3273.800=-41.200
σ482.256-387.011=95.245
min2743.000-2746.000=-3.000
max3923.000-3641.000=282.000
mean8.784-8.819=-0.035
σ0.175-0.115=0.060
min8.635-8.665=-0.030
max9.028-8.985=0.043

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.976-1.030=-0.054
σ0.063-0.067=-0.003
min0.941-0.940=0.001
max1.088-1.081=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.481-465.481=-0.001
σ572.664-572.663=0.001
min179.140-179.142=-0.002
max1324.476-1324.476=0.000
mean79.500
σ7.000
min76.000
max90.000
mean2743.000-2746.000=-3.000
σ0.000
min2743.000-2746.000=-3.000
max2743.000-2746.000=-3.000
mean0.483-0.468=0.016
σ0.404-0.373=0.031
min0.280-0.277=0.003
max1.089-1.028=0.061
policies=20
mean1791.704-1791.702=0.003
σ0.325-0.332=-0.007
min1791.512-1791.509=0.003
max1792.188-1792.197=-0.009
mean760.000
σ0.000
min760.000
max760.000
mean2743.000-2746.000=-3.000
σ0.000
min2743.000-2746.000=-3.000
max2743.000-2746.000=-3.000
mean2.809-2.811=-0.002
σ0.007-0.027=-0.020
min2.804-2.774=0.031
max2.819-2.833=-0.014
policies=200
mean17923.525-17923.479=0.046
σ0.479-0.535=-0.056
min17923.257-17923.148=0.109
max17924.243-17924.277=-0.035
mean7600.000
σ0.000
min7600.000
max7600.000
mean2743.000-2746.000=-3.000
σ0.000
min2743.000-2746.000=-3.000
max2743.000-2746.000=-3.000
mean28.269-28.268=0.001
σ0.110-0.063=0.047
min28.170-28.208=-0.037
max28.364-28.335=0.030