Compare commits

Home / Compare 9f6de5ab .. 11fde42d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.697-70.704=-0.007
σ0.047-0.044=0.002
min70.674-70.677=-0.003
max70.827-70.825=0.002
mean416.000-416.400=-0.400
σ0.000-0.516=-0.516
min416.000
max416.000-417.000=-1.000
mean0.160-0.172=-0.012
σ0.004-0.011=-0.006
min0.152-0.157=-0.005
max0.168-0.185=-0.018
cache=y
dps=1
iters=10
policies=100
mean21.424-21.421=0.003
σ0.011-0.003=0.008
min21.416-21.415=0.001
max21.454-21.423=0.030
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.065-0.066=-0.000
σ0.003-0.002=0.001
min0.061-0.063=-0.002
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1754.459=-0.000
σ0.361-0.361=-0.000
min1753.891-1753.887=0.004
max1755.038-1755.040=-0.002
mean1670.300-1646.350=23.950
σ650.919-627.215=23.704
min641.000-627.000=14.000
max2864.000-2854.000=10.000
mean2.781-2.820=-0.040
σ0.216-0.123=0.093
min2.270-2.517=-0.247
max3.241-3.044=0.197

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.998-279.000=-0.002
σ0.007-0.009=-0.002
min278.986-278.991=-0.005
max279.003-279.013=-0.010
mean2864.000-2854.000=10.000
σ0.000
min2864.000-2854.000=10.000
max2864.000-2854.000=10.000
mean0.385-0.387=-0.001
σ0.008-0.006=0.001
min0.380-0.380=-0.000
max0.398-0.396=0.003
iters=5
new-facts=1
prior-facts=6402
mean1939.427-1939.430=-0.003
σ0.020-0.021=-0.001
min1939.398-1939.395=0.003
max1939.445-1939.450=-0.005
mean2864.000-2854.000=10.000
σ0.000
min2864.000-2854.000=10.000
max2864.000-2854.000=10.000
mean2.571-2.557=0.013
σ0.115-0.110=0.005
min2.499-2.473=0.026
max2.771-2.748=0.022
iters=5
new-facts=6402
prior-facts=1
mean4760.041-4760.208=-0.167
σ0.976-0.878=0.098
min4759.382-4759.688=-0.306
max4761.770-4761.770=0.000
mean2864.000-2854.000=10.000
σ0.000
min2864.000-2854.000=10.000
max2864.000-2854.000=10.000
mean8.516-8.369=0.147
σ0.589-0.394=0.195
min7.855-7.827=0.028
max9.016-8.931=0.085
iters=5
new-facts=6402
prior-facts=6402
mean4950.627-4950.479=0.148
σ0.027-0.313=-0.287
min4950.591-4949.920=0.671
max4950.656-4950.641=0.014
mean3078.600-3087.200=-8.600
σ289.376-307.362=-17.987
min2864.000-2854.000=10.000
max3529.000-3559.000=-30.000
mean8.492-8.438=0.054
σ0.116-0.157=-0.041
min8.419-8.272=0.146
max8.691-8.693=-0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.024-1.028=-0.004
σ0.132-0.144=-0.012
min0.935-0.930=0.005
max1.238-1.259=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.063-473.078=-0.015
σ575.910-575.910=0.000
min185.100-185.114=-0.014
max1336.929-1336.943=-0.014
mean88.250
σ8.500
min84.000
max101.000
mean2864.000-2854.000=10.000
σ0.000
min2864.000-2854.000=10.000
max2864.000-2854.000=10.000
mean0.480-0.487=-0.007
σ0.357-0.374=-0.017
min0.299-0.297=0.002
max1.015-1.048=-0.033
policies=20
mean1851.300-1851.399=-0.099
σ0.374-0.371=0.003
min1851.021-1851.131=-0.109
max1851.844-1851.940=-0.096
mean840.000
σ0.000
min840.000
max840.000
mean2864.000-2854.000=10.000
σ0.000
min2864.000-2854.000=10.000
max2864.000-2854.000=10.000
mean2.958-2.956=0.002
σ0.008-0.010=-0.002
min2.949-2.947=0.002
max2.965-2.965=-0.000
policies=200
mean18519.413-18519.623=-0.209
σ0.381-0.721=-0.340
min18519.156-18518.893=0.264
max18519.970-18520.443=-0.474
mean8400.000
σ0.000
min8400.000
max8400.000
mean2864.000-2854.000=10.000
σ0.000
min2864.000-2854.000=10.000
max2864.000-2854.000=10.000
mean29.124-29.107=0.017
σ0.475-0.491=-0.016
min28.802-28.784=0.018
max29.831-29.830=0.000