Compare commits

Home / Compare 80916a05 .. 25191c08

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.973=0.001
σ0.105-0.107=-0.001
min35.927-35.922=0.004
max36.273-36.276=-0.003
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.077-0.077=-0.001
σ0.003-0.004=-0.001
min0.074-0.072=0.002
max0.083-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.005-0.003=0.002
min26.203-26.204=-0.001
max26.216-26.212=0.004
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.061-0.060=0.000
σ0.003-0.003=0.000
min0.059-0.057=0.002
max0.070-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.377-1758.379=-0.002
σ0.369-0.371=-0.002
min1757.799-1757.803=-0.004
max1758.978-1758.979=-0.000
mean1658.600-1630.700=27.900
σ620.965-621.710=-0.745
min688.000-637.000=51.000
max2748.000-2815.000=-67.000
mean2.382-2.377=0.005
σ0.171-0.115=0.056
min2.082-2.283=-0.201
max2.891-2.782=0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.543-279.542=0.001
σ0.009-0.010=-0.001
min279.533-279.532=0.001
max279.553-279.555=-0.002
mean2748.000-2815.000=-67.000
σ0.000
min2748.000-2815.000=-67.000
max2748.000-2815.000=-67.000
mean0.409-0.414=-0.005
σ0.007-0.008=-0.001
min0.404-0.408=-0.003
max0.422-0.425=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2178.478-2178.455=0.023
σ0.017-0.032=-0.015
min2178.449-2178.416=0.033
max2178.490-2178.493=-0.003
mean2748.000-2815.000=-67.000
σ0.000
min2748.000-2815.000=-67.000
max2748.000-2815.000=-67.000
mean3.398-3.341=0.057
σ0.306-0.069=0.237
min2.902-3.258=-0.356
max3.739-3.426=0.313
iters=5
new-facts=6402
prior-facts=1
mean5056.283-5056.404=-0.120
σ1.130-0.993=0.137
min5055.238-5055.795=-0.557
max5058.208-5058.170=0.038
mean2748.000-2815.000=-67.000
σ0.000
min2748.000-2815.000=-67.000
max2748.000-2815.000=-67.000
mean9.130-8.918=0.212
σ0.613-0.615=-0.002
min8.205-8.233=-0.028
max9.860-9.684=0.177
iters=5
new-facts=6402
prior-facts=6402
mean5193.789-5193.549=0.240
σ0.091-0.364=-0.273
min5193.716-5192.944=0.772
max5193.891-5193.881=0.010
mean3235.000-3296.400=-61.400
σ359.397-440.858=-81.461
min2748.000-2815.000=-67.000
max3678.000-3921.000=-243.000
mean8.987-8.898=0.090
σ0.410-0.055=0.355
min8.651-8.849=-0.197
max9.685-8.982=0.703

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.011-0.999=0.012
σ0.142-0.068=0.074
min0.945-0.944=0.001
max1.264-1.079=0.185

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.539-465.557=-0.018
σ572.662-572.658=0.004
min179.200-179.221=-0.021
max1324.532-1324.544=-0.012
mean79.500
σ7.000
min76.000
max90.000
mean2748.000-2815.000=-67.000
σ0.000
min2748.000-2815.000=-67.000
max2748.000-2815.000=-67.000
mean0.490-0.449=0.042
σ0.415-0.307=0.108
min0.280-0.294=-0.014
max1.113-0.910=0.204
policies=20
mean1792.304-1792.468=-0.164
σ0.337-0.343=-0.006
min1792.099-1792.233=-0.134
max1792.806-1792.971=-0.165
mean760.000
σ0.000
min760.000
max760.000
mean2748.000-2815.000=-67.000
σ0.000
min2748.000-2815.000=-67.000
max2748.000-2815.000=-67.000
mean2.812-2.910=-0.098
σ0.007-0.005=0.002
min2.804-2.903=-0.099
max2.820-2.913=-0.094
policies=200
mean17929.389-17929.927=-0.537
σ0.459-0.727=-0.268
min17929.048-17929.297=-0.249
max17930.060-17930.751=-0.691
mean7600.000
σ0.000
min7600.000
max7600.000
mean2748.000-2815.000=-67.000
σ0.000
min2748.000-2815.000=-67.000
max2748.000-2815.000=-67.000
mean28.325-28.713=-0.389
σ0.142-0.471=-0.329
min28.179-28.268=-0.089
max28.497-29.371=-0.874