Compare commits

Home / Compare b25edccb .. 17757462

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.697-70.697=0.000
σ0.048-0.047=0.001
min70.664-70.674=-0.010
max70.830-70.827=0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.164-0.160=0.004
σ0.009-0.004=0.005
min0.157-0.152=0.005
max0.187-0.168=0.019
cache=y
dps=1
iters=10
policies=100
mean21.421-21.424=-0.004
σ0.003-0.011=-0.008
min21.417-21.416=0.001
max21.425-21.454=-0.029
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.064-0.065=-0.001
σ0.004-0.003=0.001
min0.060-0.061=-0.001
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.457-1754.459=-0.001
σ0.362-0.361=0.001
min1753.886-1753.891=-0.005
max1755.051-1755.038=0.013
mean1663.300-1670.300=-7.000
σ628.468-650.919=-22.451
min673.000-641.000=32.000
max2603.000-2864.000=-261.000
mean2.756-2.781=-0.024
σ0.202-0.216=-0.014
min2.148-2.270=-0.122
max3.057-3.241=-0.184

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.993-278.998=-0.004
σ0.006-0.007=-0.001
min278.987-278.986=0.000
max279.000-279.003=-0.003
mean2603.000-2864.000=-261.000
σ0.000
min2603.000-2864.000=-261.000
max2603.000-2864.000=-261.000
mean0.384-0.385=-0.001
σ0.007-0.008=-0.001
min0.379-0.380=-0.001
max0.394-0.398=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1939.435-1939.427=0.008
σ0.008-0.020=-0.012
min1939.428-1939.398=0.030
max1939.447-1939.445=0.002
mean2603.000-2864.000=-261.000
σ0.000
min2603.000-2864.000=-261.000
max2603.000-2864.000=-261.000
mean2.600-2.571=0.030
σ0.134-0.115=0.019
min2.515-2.499=0.016
max2.829-2.771=0.059
iters=5
new-facts=6402
prior-facts=1
mean4760.114-4760.041=0.073
σ0.953-0.976=-0.023
min4759.262-4759.382=-0.121
max4761.750-4761.770=-0.021
mean2603.000-2864.000=-261.000
σ0.000
min2603.000-2864.000=-261.000
max2603.000-2864.000=-261.000
mean8.426-8.516=-0.090
σ0.550-0.589=-0.039
min7.859-7.855=0.005
max9.085-9.016=0.069
iters=5
new-facts=6402
prior-facts=6402
mean4950.631-4950.627=0.004
σ0.010-0.027=-0.017
min4950.622-4950.591=0.032
max4950.647-4950.656=-0.008
mean3000.200-3078.600=-78.400
σ401.757-289.376=112.381
min2603.000-2864.000=-261.000
max3570.000-3529.000=41.000
mean8.660-8.492=0.168
σ0.288-0.116=0.172
min8.396-8.419=-0.022
max9.086-8.691=0.395

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.365-1.024=0.341
σ0.356-0.132=0.224
min0.939-0.935=0.004
max1.836-1.238=0.597

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.060-473.063=-0.003
σ575.921-575.910=0.011
min185.097-185.100=-0.003
max1336.942-1336.929=0.013
mean88.250
σ8.500
min84.000
max101.000
mean2603.000-2864.000=-261.000
σ0.000
min2603.000-2864.000=-261.000
max2603.000-2864.000=-261.000
mean0.548-0.480=0.068
σ0.519-0.357=0.162
min0.285-0.299=-0.014
max1.326-1.015=0.311
policies=20
mean1851.251-1851.300=-0.049
σ0.370-0.374=-0.004
min1851.014-1851.021=-0.007
max1851.799-1851.844=-0.045
mean840.000
σ0.000
min840.000
max840.000
mean2603.000-2864.000=-261.000
σ0.000
min2603.000-2864.000=-261.000
max2603.000-2864.000=-261.000
mean2.861-2.958=-0.098
σ0.016-0.008=0.009
min2.842-2.949=-0.107
max2.879-2.965=-0.086
policies=200
mean18519.479-18519.413=0.066
σ0.470-0.381=0.089
min18519.211-18519.156=0.055
max18520.183-18519.970=0.214
mean8400.000
σ0.000
min8400.000
max8400.000
mean2603.000-2864.000=-261.000
σ0.000
min2603.000-2864.000=-261.000
max2603.000-2864.000=-261.000
mean28.792-29.124=-0.332
σ0.053-0.475=-0.422
min28.737-28.802=-0.065
max28.864-29.831=-0.967