Compare commits

Home / Compare 06cbeeb2 .. c3d7557b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=-0.000
σ0.046-0.047=-0.001
min70.749-70.750=-0.001
max70.908-70.911=-0.003
mean413.000-411.900=1.100
σ0.000-0.316=-0.316
min413.000-411.000=2.000
max413.000-412.000=1.000
mean0.159-0.158=0.001
σ0.005-0.005=0.001
min0.151-0.152=-0.001
max0.169-0.164=0.005
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=0.000
σ0.003-0.003=-0.000
min21.488-21.488=-0.000
max21.498-21.497=0.000
mean413.000-412.800=0.200
σ0.000-0.422=-0.422
min413.000-412.000=1.000
max413.000
mean0.061-0.061=-0.000
σ0.003-0.003=0.000
min0.058-0.059=-0.000
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.093=-0.001
σ0.361-0.362=-0.001
min1753.528-1753.526=0.002
max1754.676-1754.692=-0.016
mean1630.850-1637.450=-6.600
σ611.351-618.099=-6.747
min637.000-641.000=-4.000
max2451.000-2476.000=-25.000
mean2.791-2.779=0.012
σ0.165-0.190=-0.025
min2.330-2.120=0.210
max2.996-3.018=-0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.957-271.956=0.001
σ0.006-0.005=0.000
min271.950-271.950=-0.000
max271.965-271.964=0.001
mean2451.000-2476.000=-25.000
σ0.000
min2451.000-2476.000=-25.000
max2451.000-2476.000=-25.000
mean0.385-0.380=0.005
σ0.006-0.001=0.005
min0.381-0.378=0.003
max0.396-0.382=0.014
iters=5
new-facts=1
prior-facts=6402
mean1932.316-1932.318=-0.002
σ0.011-0.010=0.000
min1932.298-1932.306=-0.008
max1932.323-1932.331=-0.008
mean2451.000-2476.000=-25.000
σ0.000
min2451.000-2476.000=-25.000
max2451.000-2476.000=-25.000
mean3.096-3.073=0.022
σ0.107-0.117=-0.010
min3.016-2.943=0.073
max3.264-3.230=0.034
iters=5
new-facts=6402
prior-facts=1
mean4753.055-4753.120=-0.065
σ0.928-0.886=0.042
min4752.587-4752.577=0.011
max4754.713-4754.693=0.020
mean2451.000-2476.000=-25.000
σ0.000
min2451.000-2476.000=-25.000
max2451.000-2476.000=-25.000
mean8.739-8.428=0.311
σ0.478-0.511=-0.033
min7.964-7.624=0.339
max9.158-8.990=0.168
iters=5
new-facts=6402
prior-facts=6402
mean4943.415-4943.558=-0.144
σ0.199-0.017=0.182
min4943.197-4943.538=-0.341
max4943.576-4943.576=-0.000
mean2950.800-2960.400=-9.600
σ271.821-271.145=0.676
min2584.000-2601.000=-17.000
max3304.000-3309.000=-5.000
mean8.490-8.487=0.003
σ0.036-0.060=-0.024
min8.432-8.421=0.010
max8.519-8.586=-0.067

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.819-1.695=0.124
σ0.121-0.098=0.023
min1.633-1.597=0.036
max1.931-1.835=0.096

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.651-468.630=0.021
σ574.922-574.927=-0.005
min181.187-181.166=0.021
max1331.034-1331.020=0.014
mean88.250
σ8.500
min84.000
max101.000
mean2451.000-2476.000=-25.000
σ0.000
min2451.000-2476.000=-25.000
max2451.000-2476.000=-25.000
mean0.567-0.547=0.020
σ0.552-0.516=0.036
min0.286-0.283=0.003
max1.394-1.321=0.073
policies=20
mean1812.167-1811.957=0.211
σ0.385-0.380=0.004
min1811.912-1811.705=0.207
max1812.737-1812.518=0.218
mean840.000
σ0.000
min840.000
max840.000
mean2451.000-2476.000=-25.000
σ0.000
min2451.000-2476.000=-25.000
max2451.000-2476.000=-25.000
mean2.820-2.828=-0.007
σ0.017-0.009=0.008
min2.802-2.818=-0.016
max2.842-2.837=0.005
policies=200
mean18129.194-18126.616=2.577
σ0.538-0.593=-0.055
min18128.799-18126.238=2.561
max18129.988-18127.501=2.487
mean8400.000
σ0.000
min8400.000
max8400.000
mean2451.000-2476.000=-25.000
σ0.000
min2451.000-2476.000=-25.000
max2451.000-2476.000=-25.000
mean28.474-28.391=0.082
σ0.088-0.104=-0.016
min28.399-28.308=0.092
max28.588-28.527=0.060