Compare commits

Home / Compare e818fe5c .. 7e9ddae2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-36.727=-0.754
σ0.108-0.614=-0.506
min35.924-35.925=-0.001
max36.279-37.222=-0.943
mean416.000-3972.000=-3556.000
σ0.000
min416.000-3972.000=-3556.000
max416.000-3972.000=-3556.000
mean0.078-0.075=0.003
σ0.004-0.001=0.004
min0.074-0.074=-0.000
max0.086-0.077=0.009
cache=y
dps=1
iters=10
policies=100
mean26.208-26.713=-0.504
σ0.004-0.646=-0.642
min26.202-26.208=-0.005
max26.216-27.470=-1.254
mean416.000-3972.000=-3556.000
σ0.000
min416.000-3972.000=-3556.000
max416.000-3972.000=-3556.000
mean0.061-0.061=0.000
σ0.003-0.001=0.002
min0.060-0.060=-0.000
max0.068-0.062=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1756.369=1.994
σ0.372-0.372=-0.000
min1757.786-1755.797=1.989
max1758.965-1756.967=1.998
mean1659.450-1653.850=5.600
σ621.733-627.740=-6.007
min690.000-680.000=10.000
max2760.000-2604.000=156.000
mean2.394-2.275=0.120
σ0.114-0.141=-0.027
min2.287-2.160=0.127
max2.665-2.805=-0.140

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.498-278.696=0.802
σ0.016-0.013=0.003
min279.480-278.684=0.796
max279.514-278.718=0.796
mean2760.000-2604.000=156.000
σ0.000
min2760.000-2604.000=156.000
max2760.000-2604.000=156.000
mean0.410-0.418=-0.008
σ0.002-0.004=-0.001
min0.407-0.416=-0.009
max0.414-0.425=-0.011
iters=5
new-facts=1
prior-facts=6402
mean2178.423-2268.872=-90.450
σ0.032-0.004=0.028
min2178.378-2268.868=-90.490
max2178.465-2268.877=-90.412
mean2760.000-2604.000=156.000
σ0.000
min2760.000-2604.000=156.000
max2760.000-2604.000=156.000
mean3.432-2.954=0.478
σ0.087-0.121=-0.034
min3.291-2.875=0.416
max3.517-3.165=0.353
iters=5
new-facts=6402
prior-facts=1
mean5056.380-4952.326=104.054
σ0.979-0.864=0.115
min5055.815-4951.869=103.946
max5058.125-4953.867=104.257
mean2760.000-2604.000=156.000
σ0.000
min2760.000-2604.000=156.000
max2760.000-2604.000=156.000
mean8.860-8.128=0.732
σ0.612-0.291=0.322
min8.061-7.696=0.364
max9.556-8.407=1.149
iters=5
new-facts=6402
prior-facts=6402
mean5193.747-5167.006=26.741
σ0.101-0.160=-0.059
min5193.641-5166.720=26.921
max5193.857-5167.091=26.767
mean3296.000-3407.000=-111.000
σ400.590-464.641=-64.051
min2760.000-2752.000=8.000
max3680.000-3972.000=-292.000
mean8.879-9.290=-0.411
σ0.169-0.104=0.066
min8.611-9.125=-0.514
max9.049-9.386=-0.337

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.969-1.110=-0.140
σ0.054-0.152=-0.097
min0.937-0.957=-0.019
max1.064-1.364=-0.300

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.478-460.259=5.219
σ572.662-572.608=0.054
min179.140-173.954=5.186
max1324.471-1319.171=5.300
mean79.500
σ7.000
min76.000
max90.000
mean2760.000-435.000=2325.000
σ0.000
min2760.000-435.000=2325.000
max2760.000-435.000=2325.000
mean0.480-0.555=-0.075
σ0.397-0.563=-0.166
min0.279-0.273=0.006
max1.075-1.399=-0.324
policies=20
mean1791.671-1740.059=51.612
σ0.339-0.328=0.011
min1791.476-1739.813=51.664
max1792.177-1740.539=51.638
mean760.000
σ0.000
min760.000
max760.000
mean2760.000-444.500=2315.500
σ0.000-8.813=-8.813
min2760.000-435.000=2325.000
max2760.000-452.000=2308.000
mean2.811-2.655=0.156
σ0.017-0.006=0.011
min2.790-2.648=0.142
max2.827-2.662=0.165
policies=200
mean17923.160-17409.810=513.350
σ0.313-0.064=0.249
min17922.894-17409.732=513.162
max17923.612-17409.880=513.732
mean7600.000
σ0.000
min7600.000
max7600.000
mean2760.000-488.500=2271.500
σ0.000-2.082=-2.082
min2760.000-486.000=2274.000
max2760.000-491.000=2269.000
mean28.333-26.832=1.501
σ0.123-0.167=-0.044
min28.220-26.668=1.552
max28.453-27.023=1.430