Compare commits

Home / Compare b46de35e .. 33a3cad9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean34.479-34.479=0.000
σ0.371-0.373=-0.002
min34.348-34.346=0.002
max35.534-35.539=-0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.084-0.084=-0.000
σ0.006-0.003=0.003
min0.077-0.082=-0.005
max0.095-0.091=0.005
cache=y
dps=1
iters=10
policies=100
mean22.810-22.808=0.002
σ0.003-0.003=-0.000
min22.803-22.803=0.001
max22.814-22.812=0.002
mean415.000
σ0.000-1.054=-1.054
min415.000-414.000=1.000
max415.000-416.000=-1.000
mean0.066-0.064=0.002
σ0.002-0.004=-0.002
min0.062-0.059=0.003
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1733.273-1733.273=0.000
σ1.034-1.034=-0.000
min1732.460-1732.455=0.005
max1737.415-1737.415=0.001
mean1662.750-1643.650=19.100
σ647.238-621.825=25.412
min648.000-677.000=-29.000
max2831.000-2837.000=-6.000
mean2.569-2.532=0.037
σ0.286-0.263=0.023
min2.258-2.245=0.014
max3.136-2.988=0.147

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean292.431-292.429=0.002
σ0.017-0.013=0.004
min292.405-292.407=-0.002
max292.450-292.441=0.009
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean0.398-0.398=-0.000
σ0.002-0.002=0.000
min0.396-0.395=0.001
max0.401-0.401=0.001
iters=5
new-facts=1
prior-facts=6402
mean1952.963-1952.972=-0.009
σ0.019-0.019=-0.001
min1952.937-1952.939=-0.001
max1952.982-1952.988=-0.006
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean2.579-2.633=-0.054
σ0.042-0.088=-0.046
min2.535-2.561=-0.027
max2.625-2.743=-0.118
iters=5
new-facts=6402
prior-facts=1
mean4778.914-4778.878=0.035
σ7.744-7.634=0.110
min4775.324-4775.302=0.021
max4792.766-4792.531=0.234
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean9.096-8.684=0.412
σ0.406-0.453=-0.046
min8.783-7.979=0.804
max9.792-9.234=0.558
iters=5
new-facts=6402
prior-facts=6402
mean4966.231-4966.373=-0.141
σ0.378-0.208=0.170
min4965.665-4966.030=-0.364
max4966.541-4966.543=-0.002
mean3053.400-3038.600=14.800
σ217.482-204.071=13.411
min2831.000-2837.000=-6.000
max3329.000-3317.000=12.000
mean8.567-8.596=-0.029
σ0.140-0.254=-0.113
min8.367-8.369=-0.002
max8.682-9.008=-0.326

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-0.968=0.150
σ0.230-0.140=0.089
min0.920-0.899=0.021
max1.516-1.218=0.297

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean435.891-435.890=0.000
σ572.814-572.824=-0.010
min149.474-149.476=-0.001
max1295.112-1295.126=-0.014
mean86.250
σ8.500
min82.000
max99.000
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean0.406-0.407=-0.001
σ0.299-0.305=-0.006
min0.255-0.244=0.011
max0.854-0.864=-0.009
policies=20
mean1494.970-1494.986=-0.016
σ0.266-0.258=0.008
min1494.785-1494.804=-0.019
max1495.365-1495.366=-0.001
mean820.000
σ0.000
min820.000
max820.000
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean2.568-2.577=-0.009
σ0.011-0.005=0.007
min2.555-2.570=-0.015
max2.579-2.581=-0.002
policies=200
mean14957.181-14957.163=0.017
σ0.479-0.426=0.054
min14956.833-14956.911=-0.078
max14957.888-14957.800=0.087
mean8200.000
σ0.000
min8200.000
max8200.000
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean25.481-25.558=-0.078
σ0.440-0.449=-0.010
min25.065-25.162=-0.097
max25.862-26.030=-0.168