Compare commits

Home / Compare 87cbc610 .. 75487f9e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727
σ0.614
min35.928
max37.213
mean3829.000
σ0.000
min3829.000
max3829.000
mean0.076
σ0.002
min0.075
max0.081
cache=y
dps=1
iters=10
policies=100
mean26.713
σ0.647
min26.205
max27.469
mean3829.000
σ0.000
min3829.000
max3829.000
mean0.061
σ0.001
min0.060
max0.065

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.366-1756.306=0.060
σ0.372-0.367=0.005
min1755.789-1755.749=0.040
max1756.956-1756.900=0.057
mean1663.750-1656.250=7.500
σ632.515-625.687=6.828
min684.000-615.000=69.000
max2616.000-2663.000=-47.000
mean2.222-2.230=-0.008
σ0.071-0.070=0.001
min2.141-2.150=-0.009
max2.345-2.347=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.698-278.695=0.003
σ0.013-0.013=-0.001
min278.683-278.679=0.004
max278.715-278.711=0.004
mean2616.000-2663.000=-47.000
σ0.000
min2616.000-2663.000=-47.000
max2616.000-2663.000=-47.000
mean0.417-0.419=-0.002
σ0.002-0.001=0.001
min0.415-0.418=-0.004
max0.419-0.420=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.854-2268.834=0.020
σ0.024-0.009=0.015
min2268.825-2268.825=-0.000
max2268.874-2268.845=0.029
mean2616.000-2663.000=-47.000
σ0.000
min2616.000-2663.000=-47.000
max2616.000-2663.000=-47.000
mean3.140-3.582=-0.441
σ0.148-0.173=-0.025
min2.912-3.408=-0.497
max3.272-3.816=-0.545
iters=5
new-facts=6402
prior-facts=1
mean4952.120-4956.057=-3.937
σ0.713-0.815=-0.102
min4951.416-4955.630=-4.215
max4953.317-4957.511=-4.194
mean2616.000-2663.000=-47.000
σ0.000
min2616.000-2663.000=-47.000
max2616.000-2663.000=-47.000
mean7.892-7.831=0.061
σ0.381-0.171=0.210
min7.555-7.663=-0.108
max8.547-8.026=0.521
iters=5
new-facts=6402
prior-facts=6402
mean5167.067-5170.698=-3.630
σ0.015-0.222=-0.207
min5167.055-5170.323=-3.268
max5167.093-5170.851=-3.758
mean3366.600-3421.800=-55.200
σ452.598-458.214=-5.616
min2925.000-2826.000=99.000
max3829.000-4064.000=-235.000
mean9.106-9.303=-0.197
σ0.422-0.359=0.063
min8.547-8.952=-0.405
max9.705-9.684=0.022

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.557-1.028=0.529
σ0.376-0.135=0.241
min1.081-0.940=0.140
max1.860-1.254=0.606

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.257-460.255=0.002
σ572.608-572.607=0.000
min173.952-173.950=0.001
max1319.169-1319.166=0.003
mean79.500
σ7.000
min76.000
max90.000
mean436.000
σ0.000
min436.000
max436.000
mean0.559-0.572=-0.013
σ0.563-0.589=-0.027
min0.274-0.273=0.002
max1.402-1.456=-0.053
policies=20
mean1740.045-1740.006=0.038
σ0.332-0.332=-0.000
min1739.798-1739.769=0.029
max1740.530-1740.494=0.036
mean760.000
σ0.000
min760.000
max760.000
mean446.250-445.750=0.500
σ9.179-9.605=-0.426
min436.000
max454.000
mean2.665-2.674=-0.009
σ0.008-0.012=-0.004
min2.658-2.662=-0.004
max2.675-2.690=-0.015
policies=200
mean17409.776-17409.313=0.463
σ0.059-0.060=-0.001
min17409.711-17409.234=0.477
max17409.841-17409.378=0.463
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.750-492.750=-2.000
σ3.096-3.594=-0.498
min488.000
max495.000-496.000=-1.000
mean26.837-27.019=-0.182
σ0.164-0.092=0.073
min26.684-26.926=-0.241
max27.065-27.145=-0.080