Compare commits

Home / Compare 54e6d734 .. eb85967a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.329-1753.250=2.080
σ0.366-0.363=0.003
min1754.755-1752.678=2.077
max1755.920-1753.840=2.080
mean1654.300-1654.500=-0.200
σ615.385-633.590=-18.205
min683.000-674.000=9.000
max2642.000-2732.000=-90.000
mean2.235-2.769=-0.533
σ0.097-0.152=-0.054
min2.079-2.453=-0.374
max2.432-3.081=-0.648

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.715-274.418=3.296
σ0.015-0.009=0.005
min277.699-274.404=3.295
max277.731-274.429=3.302
mean2642.000-2732.000=-90.000
σ0.000
min2642.000-2732.000=-90.000
max2642.000-2732.000=-90.000
mean0.408-0.408=0.001
σ0.001-0.001=-0.000
min0.407-0.405=0.001
max0.410-0.409=0.001
iters=5
new-facts=1
prior-facts=6402
mean2267.892-2264.644=3.249
σ0.005-0.022=-0.017
min2267.887-2264.621=3.267
max2267.899-2264.665=3.235
mean2642.000-2732.000=-90.000
σ0.000
min2642.000-2732.000=-90.000
max2642.000-2732.000=-90.000
mean2.912-3.210=-0.298
σ0.103-0.211=-0.108
min2.802-2.949=-0.147
max3.066-3.515=-0.449
iters=5
new-facts=6402
prior-facts=1
mean4954.965-4951.647=3.319
σ0.913-0.837=0.076
min4954.121-4950.883=3.238
max4956.529-4953.071=3.458
mean2642.000-2732.000=-90.000
σ0.000
min2642.000-2732.000=-90.000
max2642.000-2732.000=-90.000
mean7.917-8.047=-0.130
σ0.178-0.262=-0.084
min7.734-7.680=0.054
max8.198-8.327=-0.129
iters=5
new-facts=6402
prior-facts=6402
mean5169.653-5166.461=3.192
σ0.149-0.086=0.063
min5169.501-5166.374=3.127
max5169.851-5166.556=3.294
mean3382.600-3378.800=3.800
σ452.270-436.933=15.337
min2810.000-2951.000=-141.000
max3990.000-3824.000=166.000
mean9.326-9.238=0.088
σ0.047-0.422=-0.375
min9.275-8.618=0.657
max9.395-9.693=-0.298

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.629=-0.604
σ0.194-0.227=-0.032
min0.927-1.287=-0.360
max1.373-1.876=-0.504

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean456.315-454.911=1.404
σ572.594-572.575=0.018
min170.015-168.623=1.392
max1315.206-1313.774=1.432
mean79.500
σ7.000
min76.000
max90.000
mean430.500-435.000=-4.500
σ0.577-0.000=0.577
min430.000-435.000=-5.000
max431.000-435.000=-4.000
mean0.541-0.529=0.012
σ0.550-0.527=0.023
min0.261-0.260=0.002
max1.366-1.319=0.047
policies=20
mean1700.719-1686.720=13.999
σ0.304-0.308=-0.003
min1700.493-1686.494=13.999
max1701.165-1687.171=13.994
mean760.000
σ0.000
min760.000
max760.000
mean440.000-446.500=-6.500
σ10.392-10.116=0.276
min431.000-435.000=-4.000
max455.000
mean2.619-2.630=-0.011
σ0.013-0.009=0.004
min2.606-2.619=-0.013
max2.632-2.640=-0.008
policies=200
mean17016.641-16876.462=140.179
σ0.060-0.076=-0.016
min17016.580-16876.413=140.167
max17016.699-16876.575=140.124
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.250-491.500=-1.250
σ3.500-1.000=2.500
min486.000-490.000=-4.000
max494.000-492.000=2.000
mean26.379-26.353=0.025
σ0.069-0.143=-0.074
min26.307-26.165=0.142
max26.471-26.488=-0.016