Compare commits

Home / Compare d167b490 .. d6e25e3e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.287-1756.286=0.001
σ0.367-0.366=0.001
min1755.726-1755.731=-0.004
max1756.880-1756.876=0.003
mean1661.500-1658.000=3.500
σ628.904-629.215=-0.310
min686.000-618.000=68.000
max2612.000-2660.000=-48.000
mean2.218-2.274=-0.056
σ0.068-0.190=-0.122
min2.133-2.042=0.091
max2.368-2.977=-0.609

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.680-278.678=0.002
σ0.007-0.012=-0.005
min278.669-278.661=0.007
max278.686-278.693=-0.007
mean2612.000-2660.000=-48.000
σ0.000
min2612.000-2660.000=-48.000
max2612.000-2660.000=-48.000
mean0.423-0.419=0.004
σ0.007-0.001=0.006
min0.417-0.418=-0.001
max0.430-0.420=0.011
iters=5
new-facts=1
prior-facts=6402
mean2268.849-2268.848=0.000
σ0.005-0.010=-0.005
min2268.842-2268.835=0.007
max2268.853-2268.858=-0.005
mean2612.000-2660.000=-48.000
σ0.000
min2612.000-2660.000=-48.000
max2612.000-2660.000=-48.000
mean2.974-2.967=0.007
σ0.175-0.144=0.031
min2.856-2.889=-0.033
max3.272-3.223=0.048
iters=5
new-facts=6402
prior-facts=1
mean4952.235-4952.232=0.003
σ0.840-0.763=0.077
min4951.769-4951.709=0.060
max4953.730-4953.578=0.152
mean2612.000-2660.000=-48.000
σ0.000
min2612.000-2660.000=-48.000
max2612.000-2660.000=-48.000
mean8.108-7.903=0.205
σ0.277-0.317=-0.040
min7.739-7.709=0.031
max8.495-8.455=0.040
iters=5
new-facts=6402
prior-facts=6402
mean5166.949-5166.953=-0.004
σ0.086-0.082=0.004
min5166.885-5166.885=-0.001
max5167.044-5167.043=0.001
mean3446.800-3381.200=65.600
σ456.092-480.715=-24.623
min2865.000-2723.000=142.000
max4099.000-3983.000=116.000
mean9.258-9.379=-0.121
σ0.242-0.327=-0.085
min9.028-9.030=-0.001
max9.594-9.769=-0.175

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.172=-0.113
σ0.125-0.227=-0.102
min0.948-0.940=0.008
max1.253-1.523=-0.269

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.253-460.255=-0.002
σ572.608-572.608=0.000
min173.947-173.949=-0.002
max1319.164-1319.166=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean437.000-436.000=1.000
σ0.000
min437.000-436.000=1.000
max437.000-436.000=1.000
mean0.550-0.542=0.008
σ0.547-0.538=0.009
min0.273-0.269=0.004
max1.370-1.349=0.021
policies=20
mean1739.981-1739.998=-0.017
σ0.326-0.322=0.004
min1739.748-1739.765=-0.017
max1740.459-1740.470=-0.011
mean760.000
σ0.000
min760.000
max760.000
mean447.000-445.750=1.250
σ9.381-9.605=-0.224
min437.000-436.000=1.000
max455.000-454.000=1.000
mean2.658-2.655=0.004
σ0.004-0.012=-0.007
min2.655-2.644=0.011
max2.663-2.666=-0.002
policies=200
mean17409.304-17409.308=-0.004
σ0.115-0.087=0.029
min17409.144-17409.235=-0.090
max17409.420-17409.426=-0.006
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.500-491.250=0.250
σ2.646-1.708=0.938
min489.000
max495.000-493.000=2.000
mean26.898-26.850=0.048
σ0.147-0.090=0.057
min26.702-26.753=-0.051
max27.051-26.941=0.110