Compare commits

Home / Compare 82d40d4d .. b7ef13b7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.306-1755.330=0.976
σ0.367-0.368=-0.001
min1755.752-1754.753=0.999
max1756.898-1755.915=0.982
mean1652.850-1660.800=-7.950
σ636.462-623.278=13.184
min615.000-682.000=-67.000
max2611.000-2653.000=-42.000
mean2.244-2.265=-0.020
σ0.138-0.099=0.039
min2.087-2.143=-0.055
max2.736-2.512=0.224

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.695-277.719=0.975
σ0.014-0.008=0.006
min278.677-277.708=0.969
max278.709-277.730=0.980
mean2611.000-2653.000=-42.000
σ0.000
min2611.000-2653.000=-42.000
max2611.000-2653.000=-42.000
mean0.420-0.409=0.011
σ0.001-0.001=0.001
min0.418-0.409=0.009
max0.421-0.410=0.011
iters=5
new-facts=1
prior-facts=6402
mean2268.840-2267.869=0.971
σ0.017-0.016=0.001
min2268.822-2267.850=0.972
max2268.864-2267.888=0.976
mean2611.000-2653.000=-42.000
σ0.000
min2611.000-2653.000=-42.000
max2611.000-2653.000=-42.000
mean3.303-3.235=0.067
σ0.136-0.196=-0.060
min3.144-2.930=0.214
max3.491-3.437=0.054
iters=5
new-facts=6402
prior-facts=1
mean4955.921-4955.056=0.865
σ1.046-0.819=0.227
min4955.025-4954.595=0.430
max4957.720-4956.514=1.206
mean2611.000-2653.000=-42.000
σ0.000
min2611.000-2653.000=-42.000
max2611.000-2653.000=-42.000
mean8.126-7.919=0.206
σ0.322-0.290=0.032
min7.745-7.642=0.103
max8.620-8.323=0.297
iters=5
new-facts=6402
prior-facts=6402
mean5170.773-5169.646=1.127
σ0.084-0.222=-0.139
min5170.678-5169.343=1.335
max5170.850-5169.852=0.998
mean3454.200-3359.200=95.000
σ474.506-451.646=22.860
min2839.000-2919.000=-80.000
max4118.000-3821.000=297.000
mean9.320-9.364=-0.044
σ0.153-0.136=0.017
min9.107-9.138=-0.031
max9.459-9.474=-0.014

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.037-1.591=-0.554
σ0.137-0.303=-0.166
min0.947-1.247=-0.300
max1.262-1.859=-0.596

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.252-456.323=3.928
σ572.608-572.604=0.004
min173.947-170.019=3.928
max1319.164-1315.230=3.935
mean79.500
σ7.000
min76.000
max90.000
mean435.000-431.000=4.000
σ0.000
min435.000-431.000=4.000
max435.000-431.000=4.000
mean0.554-0.575=-0.021
σ0.546-0.605=-0.059
min0.274-0.272=0.002
max1.372-1.482=-0.110
policies=20
mean1739.984-1700.733=39.251
σ0.332-0.311=0.021
min1739.746-1700.503=39.244
max1740.473-1701.187=39.285
mean760.000
σ0.000
min760.000
max760.000
mean445.500-444.000=1.500
σ9.950-11.804=-1.854
min435.000-431.000=4.000
max454.000
mean2.662-2.630=0.032
σ0.013-0.024=-0.011
min2.651-2.608=0.043
max2.679-2.661=0.018
policies=200
mean17409.258-17016.735=392.523
σ0.167-0.061=0.107
min17409.060-17016.657=392.403
max17409.467-17016.801=392.666
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.500-489.750=2.750
σ3.416-3.775=-0.359
min489.000-486.000=3.000
max497.000-493.000=4.000
mean26.978-26.528=0.449
σ0.102-0.087=0.015
min26.894-26.412=0.482
max27.116-26.613=0.503