Compare commits

Home / Compare 3c8d8044 .. f968b6b5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=-0.000
σ0.048-0.051=-0.003
min33.947-33.941=0.006
max34.110-34.120=-0.009
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.082-0.082=0.001
σ0.005-0.005=0.001
min0.076-0.076=0.000
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.001-0.003=-0.002
min23.315-23.314=0.001
max23.319-23.326=-0.006
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.065=-0.001
σ0.004-0.003=0.001
min0.059-0.063=-0.004
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.303=0.000
σ0.364-0.365=-0.001
min1756.729-1756.731=-0.002
max1757.891-1757.891=0.000
mean1660.950-1666.600=-5.650
σ621.691-627.958=-6.267
min669.000-672.000=-3.000
max2591.000-2615.000=-24.000
mean2.371-2.369=0.002
σ0.139-0.072=0.066
min2.212-2.287=-0.075
max2.695-2.566=0.129

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.438-326.454=-0.015
σ0.059-0.027=0.032
min326.333-326.406=-0.073
max326.470-326.471=-0.001
mean2591.000-2615.000=-24.000
σ0.000
min2591.000-2615.000=-24.000
max2591.000-2615.000=-24.000
mean0.426-0.422=0.003
σ0.002-0.001=0.000
min0.425-0.421=0.003
max0.429-0.424=0.004
iters=5
new-facts=1
prior-facts=6402
mean1988.607-1988.616=-0.009
σ0.016-0.012=0.004
min1988.582-1988.598=-0.016
max1988.621-1988.630=-0.010
mean2591.000-2615.000=-24.000
σ0.000
min2591.000-2615.000=-24.000
max2591.000-2615.000=-24.000
mean2.677-2.717=-0.040
σ0.071-0.106=-0.035
min2.578-2.640=-0.062
max2.774-2.889=-0.115
iters=5
new-facts=6402
prior-facts=1
mean4813.474-4813.328=0.146
σ7.754-7.758=-0.005
min4809.903-4809.407=0.496
max4827.343-4827.198=0.145
mean2591.000-2615.000=-24.000
σ0.000
min2591.000-2615.000=-24.000
max2591.000-2615.000=-24.000
mean8.617-8.669=-0.052
σ0.606-0.332=0.274
min7.965-8.188=-0.224
max9.569-9.123=0.446
iters=5
new-facts=6402
prior-facts=6402
mean5001.008-5001.010=-0.002
σ0.019-0.023=-0.004
min5000.985-5000.983=0.003
max5001.025-5001.033=-0.007
mean2978.600-3010.000=-31.400
σ288.348-293.102=-4.753
min2591.000-2615.000=-24.000
max3319.000-3386.000=-67.000
mean9.808-9.769=0.039
σ0.088-0.152=-0.064
min9.713-9.584=0.129
max9.928-10.004=-0.076

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.240-1.132=0.109
σ0.377-0.292=0.084
min0.915-0.918=-0.003
max1.713-1.552=0.160

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.436-464.442=-0.006
σ574.790-574.784=0.006
min177.035-177.040=-0.005
max1326.621-1326.618=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2591.000-2615.000=-24.000
σ0.000
min2591.000-2615.000=-24.000
max2591.000-2615.000=-24.000
mean0.556-0.548=0.007
σ0.561-0.546=0.015
min0.272-0.271=0.000
max1.398-1.368=0.030
policies=20
mean1770.742-1770.762=-0.020
σ0.345-0.358=-0.013
min1770.519-1770.522=-0.003
max1771.255-1771.294=-0.039
mean840.000
σ0.000
min840.000
max840.000
mean2591.000-2615.000=-24.000
σ0.000
min2591.000-2615.000=-24.000
max2591.000-2615.000=-24.000
mean2.725-2.737=-0.012
σ0.011-0.025=-0.014
min2.714-2.711=0.002
max2.737-2.768=-0.032
policies=200
mean17714.794-17714.912=-0.118
σ0.622-0.474=0.148
min17714.356-17714.657=-0.302
max17715.712-17715.622=0.090
mean8400.000
σ0.000
min8400.000
max8400.000
mean2591.000-2615.000=-24.000
σ0.000
min2591.000-2615.000=-24.000
max2591.000-2615.000=-24.000
mean27.583-27.511=0.072
σ0.188-0.082=0.105
min27.410-27.424=-0.014
max27.782-27.611=0.171