Compare commits

Home / Compare 33a3cad9 .. d29ca17f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean34.477-34.479=-0.002
σ0.369-0.371=-0.002
min34.350-34.348=0.002
max35.527-35.534=-0.007
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.082-0.084=-0.001
σ0.004-0.006=-0.002
min0.078-0.077=0.000
max0.088-0.095=-0.007
cache=y
dps=1
iters=10
policies=100
mean22.810-22.810=-0.000
σ0.003-0.003=-0.001
min22.806-22.803=0.003
max22.815-22.814=0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.065-0.066=-0.001
σ0.003-0.002=0.001
min0.061-0.062=-0.001
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1732.939-1733.273=-0.335
σ1.042-1.034=0.008
min1732.163-1732.460=-0.297
max1737.125-1737.415=-0.290
mean1668.450-1662.750=5.700
σ637.856-647.238=-9.382
min675.000-648.000=27.000
max2756.000-2831.000=-75.000
mean2.766-2.569=0.196
σ0.176-0.286=-0.110
min2.245-2.258=-0.013
max3.008-3.136=-0.128

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean292.100-292.431=-0.331
σ0.006-0.017=-0.010
min292.092-292.405=-0.312
max292.107-292.450=-0.342
mean2756.000-2831.000=-75.000
σ0.000
min2756.000-2831.000=-75.000
max2756.000-2831.000=-75.000
mean0.394-0.398=-0.004
σ0.001-0.002=-0.001
min0.392-0.396=-0.003
max0.395-0.401=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1952.480-1952.963=-0.483
σ0.030-0.019=0.011
min1952.432-1952.937=-0.506
max1952.509-1952.982=-0.473
mean2756.000-2831.000=-75.000
σ0.000
min2756.000-2831.000=-75.000
max2756.000-2831.000=-75.000
mean2.646-2.579=0.067
σ0.234-0.042=0.191
min2.412-2.535=-0.122
max3.025-2.625=0.400
iters=5
new-facts=6402
prior-facts=1
mean2748.694-4778.914=-2030.220
σ7.204-7.744=-0.540
min2745.349-4775.324=-2029.975
max2761.575-4792.766=-2031.190
mean2756.000-2831.000=-75.000
σ0.000
min2756.000-2831.000=-75.000
max2756.000-2831.000=-75.000
mean5.368-9.096=-3.728
σ0.475-0.406=0.068
min4.829-8.783=-3.953
max5.808-9.792=-3.985
iters=5
new-facts=6402
prior-facts=6402
mean2935.558-4966.231=-2030.673
σ0.040-0.378=-0.338
min2935.521-4965.665=-2030.144
max2935.625-4966.541=-2030.916
mean2968.800-3053.400=-84.600
σ284.978-217.482=67.497
min2756.000-2831.000=-75.000
max3422.000-3329.000=93.000
mean5.706-8.567=-2.861
σ0.189-0.140=0.049
min5.497-8.367=-2.870
max5.939-8.682=-2.743

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.070-1.118=-0.048
σ0.227-0.230=-0.003
min0.903-0.920=-0.016
max1.459-1.516=-0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean435.889-435.891=-0.002
σ572.824-572.814=0.010
min149.468-149.474=-0.006
max1295.124-1295.112=0.012
mean86.250
σ8.500
min82.000
max99.000
mean2756.000-2831.000=-75.000
σ0.000
min2756.000-2831.000=-75.000
max2756.000-2831.000=-75.000
mean0.511-0.406=0.105
σ0.526-0.299=0.227
min0.247-0.255=-0.009
max1.300-0.854=0.446
policies=20
mean1494.947-1494.970=-0.023
σ0.202-0.266=-0.065
min1494.792-1494.785=0.007
max1495.239-1495.365=-0.125
mean820.000
σ0.000
min820.000
max820.000
mean2756.000-2831.000=-75.000
σ0.000
min2756.000-2831.000=-75.000
max2756.000-2831.000=-75.000
mean2.483-2.568=-0.085
σ0.019-0.011=0.008
min2.460-2.555=-0.095
max2.504-2.579=-0.075
policies=200
mean14957.140-14957.181=-0.041
σ0.487-0.479=0.007
min14956.872-14956.833=0.039
max14957.869-14957.888=-0.018
mean8200.000
σ0.000
min8200.000
max8200.000
mean2756.000-2831.000=-75.000
σ0.000
min2756.000-2831.000=-75.000
max2756.000-2831.000=-75.000
mean25.092-25.481=-0.389
σ0.092-0.440=-0.347
min25.016-25.065=-0.050
max25.226-25.862=-0.636