Compare commits

Home / Compare 97d1092b .. e14959f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.957=0.000
σ0.102-0.101=0.001
min35.911-35.914=-0.003
max36.246-36.243=0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.076-0.078=-0.001
σ0.003-0.004=-0.001
min0.072-0.074=-0.002
max0.083-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.202-26.203=-0.000
σ0.004-0.005=-0.002
min26.198-26.196=0.003
max26.209-26.212=-0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.058-0.061=-0.003
σ0.003-0.003=0.001
min0.056-0.060=-0.004
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.304-1756.303=0.001
σ0.370-0.368=0.002
min1755.728-1755.729=-0.001
max1756.898-1756.901=-0.004
mean1649.550-1658.200=-8.650
σ628.342-637.823=-9.481
min612.000
max2720.000-2692.000=28.000
mean2.380-2.382=-0.001
σ0.097-0.198=-0.101
min2.265-2.131=0.134
max2.586-3.077=-0.491

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.819-278.807=0.012
σ0.013-0.030=-0.017
min278.797-278.753=0.044
max278.831-278.822=0.009
mean2720.000-2692.000=28.000
σ0.000
min2720.000-2692.000=28.000
max2720.000-2692.000=28.000
mean0.413-0.410=0.002
σ0.005-0.001=0.003
min0.408-0.409=-0.001
max0.420-0.412=0.007
iters=5
new-facts=1
prior-facts=6402
mean2268.890-2268.883=0.006
σ0.012-0.010=0.001
min2268.881-2268.872=0.008
max2268.910-2268.899=0.011
mean2720.000-2692.000=28.000
σ0.000
min2720.000-2692.000=28.000
max2720.000-2692.000=28.000
mean3.188-3.006=0.182
σ0.214-0.149=0.065
min2.915-2.899=0.016
max3.427-3.256=0.171
iters=5
new-facts=6402
prior-facts=1
mean4954.230-4954.259=-0.029
σ0.985-0.966=0.020
min4953.657-4953.665=-0.008
max4955.976-4955.970=0.006
mean2720.000-2692.000=28.000
σ0.000
min2720.000-2692.000=28.000
max2720.000-2692.000=28.000
mean8.295-8.160=0.135
σ0.407-0.407=-0.001
min7.837-7.715=0.121
max8.771-8.759=0.012
iters=5
new-facts=6402
prior-facts=6402
mean5168.753-5168.751=0.002
σ0.223-0.151=0.072
min5168.375-5168.536=-0.161
max5168.897-5168.909=-0.012
mean3315.200-3447.800=-132.600
σ388.534-473.000=-84.466
min2929.000-2864.000=65.000
max3706.000-4132.000=-426.000
mean9.272-9.201=0.070
σ0.345-0.363=-0.018
min8.932-8.728=0.204
max9.789-9.628=0.160

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.986-1.103=-0.116
σ0.074-0.274=-0.200
min0.940-0.936=0.004
max1.117-1.581=-0.464

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.347-459.822=0.526
σ572.648-571.590=1.058
min174.020-174.016=0.004
max1319.319-1317.206=2.113
mean79.500
σ7.000
min76.000
max90.000
mean2720.000-2692.000=28.000
σ0.000
min2720.000-2692.000=28.000
max2720.000-2692.000=28.000
mean0.542-0.539=0.003
σ0.537-0.541=-0.003
min0.269-0.267=0.002
max1.348-1.350=-0.001
policies=20
mean1740.446-1740.426=0.019
σ0.327-0.315=0.012
min1740.252-1740.220=0.031
max1740.934-1740.895=0.039
mean760.000
σ0.000
min760.000
max760.000
mean2720.000-2692.000=28.000
σ0.000
min2720.000-2692.000=28.000
max2720.000-2692.000=28.000
mean2.704-2.690=0.014
σ0.025-0.017=0.008
min2.686-2.677=0.010
max2.740-2.712=0.028
policies=200
mean17411.312-17411.290=0.022
σ0.463-0.495=-0.032
min17411.039-17411.033=0.006
max17412.005-17412.032=-0.027
mean7600.000
σ0.000
min7600.000
max7600.000
mean2720.000-2692.000=28.000
σ0.000
min2720.000-2692.000=28.000
max2720.000-2692.000=28.000
mean27.168-27.128=0.039
σ0.075-0.052=0.023
min27.072-27.070=0.002
max27.246-27.189=0.058