Compare commits

Home / Compare bccb319f .. dfd47d68

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.951-35.952=-0.001
σ0.103-0.102=0.001
min35.904-35.906=-0.002
max36.242-36.240=0.002
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.074-0.077=-0.002
σ0.004-0.004=-0.000
min0.070-0.071=-0.001
max0.082-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.200-26.200=-0.000
σ0.005-0.005=-0.000
min26.194-26.192=0.002
max26.208-26.207=0.001
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.059-0.060=-0.001
σ0.003-0.003=0.000
min0.056-0.057=-0.001
max0.068-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.298-1756.298=-0.001
σ0.366-0.366=0.000
min1755.724-1755.721=0.003
max1756.891-1756.889=0.002
mean1654.100-1649.250=4.850
σ637.194-637.072=0.121
min607.000-618.000=-11.000
max2686.000-2728.000=-42.000
mean2.385-2.372=0.013
σ0.125-0.108=0.017
min2.268-2.266=0.002
max2.797-2.650=0.147

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.813-278.813=0.001
σ0.008-0.003=0.005
min278.801-278.809=-0.008
max278.822-278.818=0.004
mean2686.000-2728.000=-42.000
σ0.000
min2686.000-2728.000=-42.000
max2686.000-2728.000=-42.000
mean0.411-0.409=0.001
σ0.006-0.007=-0.001
min0.406-0.403=0.003
max0.418-0.416=0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.876-2268.880=-0.004
σ0.013-0.006=0.008
min2268.858-2268.876=-0.018
max2268.893-2268.889=0.004
mean2686.000-2728.000=-42.000
σ0.000
min2686.000-2728.000=-42.000
max2686.000-2728.000=-42.000
mean2.899-3.128=-0.229
σ0.060-0.276=-0.216
min2.824-2.906=-0.083
max2.978-3.593=-0.616
iters=5
new-facts=6402
prior-facts=1
mean4954.249-4954.261=-0.012
σ0.809-0.830=-0.022
min4953.755-4953.815=-0.060
max4955.687-4955.741=-0.054
mean2686.000-2728.000=-42.000
σ0.000
min2686.000-2728.000=-42.000
max2686.000-2728.000=-42.000
mean7.907-7.890=0.017
σ0.265-0.342=-0.077
min7.633-7.714=-0.081
max8.283-8.499=-0.216
iters=5
new-facts=6402
prior-facts=6402
mean5168.713-5168.786=-0.073
σ0.121-0.081=0.040
min5168.527-5168.718=-0.192
max5168.865-5168.875=-0.010
mean3361.600-3435.400=-73.800
σ464.851-507.863=-43.012
min2744.000-2843.000=-99.000
max3978.000-4192.000=-214.000
mean9.133-9.238=-0.105
σ0.442-0.312=0.130
min8.382-8.934=-0.552
max9.502-9.583=-0.081

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.137-1.031=0.106
σ0.357-0.143=0.214
min0.939-0.938=0.001
max1.768-1.265=0.503

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.810-459.809=0.001
σ571.585-571.584=0.001
min174.009-174.007=0.002
max1317.187-1317.185=0.002
mean79.500
σ7.000
min76.000
max90.000
mean2686.000-2728.000=-42.000
σ0.000
min2686.000-2728.000=-42.000
max2686.000-2728.000=-42.000
mean0.538-0.545=-0.007
σ0.543-0.559=-0.017
min0.265-0.264=0.001
max1.352-1.384=-0.032
policies=20
mean1740.322-1740.322=-0.000
σ0.316-0.311=0.004
min1740.122-1740.125=-0.003
max1740.793-1740.786=0.006
mean760.000
σ0.000
min760.000
max760.000
mean2686.000-2728.000=-42.000
σ0.000
min2686.000-2728.000=-42.000
max2686.000-2728.000=-42.000
mean2.674-2.677=-0.003
σ0.019-0.012=0.007
min2.662-2.662=0.000
max2.702-2.691=0.011
policies=200
mean17410.059-17410.144=-0.085
σ0.503-0.394=0.109
min17409.766-17409.935=-0.169
max17410.811-17410.735=0.076
mean7600.000
σ0.000
min7600.000
max7600.000
mean2686.000-2728.000=-42.000
σ0.000
min2686.000-2728.000=-42.000
max2686.000-2728.000=-42.000
mean26.966-26.974=-0.008
σ0.061-0.107=-0.047
min26.923-26.884=0.039
max27.053-27.100=-0.047