Compare commits

Home / Compare 0b9df910 .. 99c3404f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.050-0.048=0.002
min33.953-33.950=0.003
max34.117-34.111=0.006
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.086-0.082=0.004
σ0.004-0.005=-0.002
min0.082-0.078=0.004
max0.092-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.002-0.002=-0.000
min23.314-23.312=0.001
max23.320-23.319=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.065-0.064=0.001
σ0.002-0.004=-0.002
min0.064-0.060=0.005
max0.071-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.494=-0.001
σ0.364-0.363=0.001
min1756.922-1756.922=-0.000
max1758.082-1758.081=0.001
mean1648.150-1661.450=-13.300
σ625.825-623.100=2.726
min636.000-662.000=-26.000
max2835.000-2597.000=238.000
mean2.402-2.419=-0.018
σ0.065-0.129=-0.064
min2.294-2.288=0.006
max2.527-2.775=-0.248

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.618-326.638=-0.020
σ0.053-0.047=0.005
min326.530-326.555=-0.026
max326.664-326.676=-0.013
mean2835.000-2597.000=238.000
σ0.000
min2835.000-2597.000=238.000
max2835.000-2597.000=238.000
mean0.427-0.423=0.003
σ0.004-0.001=0.003
min0.424-0.422=0.002
max0.433-0.424=0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.808-1988.806=0.002
σ0.005-0.010=-0.005
min1988.801-1988.788=0.013
max1988.814-1988.814=0.000
mean2835.000-2597.000=238.000
σ0.000
min2835.000-2597.000=238.000
max2835.000-2597.000=238.000
mean2.730-2.696=0.034
σ0.137-0.074=0.063
min2.585-2.613=-0.028
max2.921-2.801=0.120
iters=5
new-facts=6402
prior-facts=1
mean4813.532-4813.669=-0.137
σ7.803-7.710=0.093
min4809.577-4810.133=-0.556
max4827.482-4827.460=0.022
mean2835.000-2597.000=238.000
σ0.000
min2835.000-2597.000=238.000
max2835.000-2597.000=238.000
mean8.822-8.601=0.221
σ0.477-0.590=-0.113
min8.092-7.690=0.401
max9.326-9.136=0.190
iters=5
new-facts=6402
prior-facts=6402
mean5001.208-5001.000=0.207
σ0.024-0.310=-0.287
min5001.185-5000.519=0.667
max5001.246-5001.231=0.015
mean2970.000-2994.000=-24.000
σ166.160-271.282=-105.123
min2835.000-2602.000=233.000
max3242.000-3324.000=-82.000
mean9.771-9.879=-0.108
σ0.155-0.251=-0.096
min9.526-9.614=-0.089
max9.954-10.292=-0.338

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.070-1.284=-0.214
σ0.254-0.381=-0.127
min0.903-0.944=-0.041
max1.503-1.822=-0.319

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.635-464.634=0.000
σ574.773-574.786=-0.013
min177.238-177.236=0.002
max1326.794-1326.813=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2835.000-2597.000=238.000
σ0.000
min2835.000-2597.000=238.000
max2835.000-2597.000=238.000
mean0.437-0.570=-0.133
σ0.304-0.587=-0.283
min0.283-0.275=0.008
max0.893-1.450=-0.557
policies=20
mean1772.724-1772.682=0.041
σ0.353-0.356=-0.003
min1772.477-1772.456=0.021
max1773.245-1773.212=0.032
mean840.000
σ0.000
min840.000
max840.000
mean2835.000-2597.000=238.000
σ0.000
min2835.000-2597.000=238.000
max2835.000-2597.000=238.000
mean2.818-2.732=0.086
σ0.023-0.007=0.015
min2.799-2.724=0.075
max2.848-2.742=0.106
policies=200
mean17734.125-17734.072=0.053
σ0.472-0.531=-0.059
min17733.786-17733.754=0.032
max17734.818-17734.865=-0.047
mean8400.000
σ0.000
min8400.000
max8400.000
mean2835.000-2597.000=238.000
σ0.000
min2835.000-2597.000=238.000
max2835.000-2597.000=238.000
mean27.917-27.565=0.352
σ0.403-0.148=0.255
min27.564-27.418=0.146
max28.377-27.759=0.618