Compare commits

Home / Compare 68b52603 .. a9a45840

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.721-36.726=-0.005
σ0.875-1.038=-0.163
min35.927-35.921=0.006
max38.602-38.462=0.140
mean3786.000-3961.000=-175.000
σ0.000
min3786.000-3961.000=-175.000
max3786.000-3961.000=-175.000
mean0.076-0.076=-0.000
σ0.002-0.003=-0.001
min0.074-0.074=0.000
max0.081-0.082=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.711-26.585=0.125
σ0.647-0.844=-0.196
min26.204-26.205=-0.001
max27.466-28.711=-1.245
mean3786.000-3961.000=-175.000
σ0.000
min3786.000-3961.000=-175.000
max3786.000-3961.000=-175.000
mean0.059-0.058=0.002
σ0.003-0.002=0.000
min0.057-0.056=0.001
max0.064-0.064=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.360-1756.357=0.003
σ0.374-0.372=0.002
min1755.785-1755.784=0.001
max1756.960-1756.953=0.006
mean1655.500-1650.800=4.700
σ627.374-640.031=-12.657
min612.000-627.000=-15.000
max2648.000-2855.000=-207.000
mean2.352-2.245=0.107
σ0.217-0.141=0.076
min2.185-2.127=0.058
max2.823-2.772=0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.677-278.671=0.006
σ0.011-0.014=-0.003
min278.666-278.658=0.009
max278.695-278.695=0.000
mean2648.000-2855.000=-207.000
σ0.000
min2648.000-2855.000=-207.000
max2648.000-2855.000=-207.000
mean0.421-0.418=0.003
σ0.009-0.001=0.008
min0.416-0.418=-0.001
max0.438-0.419=0.019
iters=5
new-facts=1
prior-facts=6402
mean2268.833-2268.849=-0.015
σ0.015-0.006=0.009
min2268.817-2268.843=-0.027
max2268.846-2268.858=-0.012
mean2648.000-2855.000=-207.000
σ0.000
min2648.000-2855.000=-207.000
max2648.000-2855.000=-207.000
mean3.152-3.013=0.138
σ0.164-0.136=0.028
min2.938-2.921=0.017
max3.336-3.240=0.096
iters=5
new-facts=6402
prior-facts=1
mean4952.000-4952.241=-0.241
σ1.091-0.843=0.248
min4950.831-4951.483=-0.652
max4953.753-4953.692=0.061
mean2648.000-2855.000=-207.000
σ0.000
min2648.000-2855.000=-207.000
max2648.000-2855.000=-207.000
mean7.916-7.754=0.162
σ0.032-0.126=-0.094
min7.883-7.629=0.254
max7.956-7.895=0.061
iters=5
new-facts=6402
prior-facts=6402
mean5167.047-5167.053=-0.007
σ0.012-0.011=0.001
min5167.038-5167.043=-0.005
max5167.067-5167.066=0.001
mean3355.600-3406.200=-50.600
σ424.705-420.833=3.872
min2937.000-2855.000=82.000
max3786.000-3961.000=-175.000
mean9.348-9.413=-0.065
σ0.275-0.408=-0.133
min9.102-9.034=0.069
max9.715-10.020=-0.304

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.635-1.017=0.618
σ0.267-0.130=0.138
min1.209-0.930=0.279
max1.903-1.228=0.675

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.253-460.254=-0.001
σ572.607-572.608=-0.000
min173.948-173.949=-0.000
max1319.165-1319.166=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean436.000-435.000=1.000
σ0.000
min436.000-435.000=1.000
max436.000-435.000=1.000
mean0.573-0.549=0.024
σ0.590-0.547=0.044
min0.275-0.274=0.001
max1.458-1.369=0.089
policies=20
mean1739.992-1740.001=-0.009
σ0.336-0.332=0.004
min1739.751-1739.765=-0.014
max1740.485-1740.487=-0.002
mean760.000
σ0.000
min760.000
max760.000
mean446.250-445.500=0.750
σ10.178-9.950=0.228
min436.000-435.000=1.000
max455.000-454.000=1.000
mean2.669-2.660=0.009
σ0.009-0.015=-0.006
min2.657-2.640=0.017
max2.677-2.676=0.000
policies=200
mean17409.072-17409.310=-0.238
σ0.071-0.053=0.018
min17408.994-17409.273=-0.279
max17409.164-17409.389=-0.225
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.750-488.250=2.500
σ1.708-2.217=-0.510
min489.000-486.000=3.000
max493.000-491.000=2.000
mean26.968-26.873=0.096
σ0.118-0.077=0.041
min26.821-26.766=0.056
max27.079-26.949=0.129