Compare commits

Home / Compare 2e77cc60 .. d0198218

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.721-70.691=0.030
σ0.045-0.048=-0.003
min70.697-70.658=0.039
max70.848-70.826=0.022
mean410.000-416.000=-6.000
σ0.000
min410.000-416.000=-6.000
max410.000-416.000=-6.000
mean0.159-0.161=-0.001
σ0.003-0.004=-0.001
min0.156-0.158=-0.002
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.445-21.420=0.026
σ0.003-0.003=0.000
min21.440-21.416=0.024
max21.449-21.425=0.024
mean410.000-416.000=-6.000
σ0.000
min410.000-416.000=-6.000
max410.000-416.000=-6.000
mean0.065-0.064=0.001
σ0.002-0.004=-0.002
min0.063-0.058=0.005
max0.071-0.074=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.528-1754.458=0.070
σ0.360-0.360=-0.001
min1753.965-1753.881=0.084
max1755.104-1755.039=0.065
mean1636.100-1670.850=-34.750
σ629.813-628.866=0.947
min634.000-664.000=-30.000
max2839.000-2620.000=219.000
mean2.791-2.800=-0.009
σ0.215-0.126=0.089
min2.314-2.412=-0.098
max3.230-2.927=0.303

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.609-273.501=0.108
σ0.006-0.005=0.001
min273.599-273.493=0.107
max273.615-273.506=0.109
mean2839.000-2620.000=219.000
σ0.000
min2839.000-2620.000=219.000
max2839.000-2620.000=219.000
mean0.385-0.378=0.007
σ0.009-0.004=0.005
min0.379-0.376=0.003
max0.402-0.386=0.016
iters=5
new-facts=1
prior-facts=6402
mean1934.007-1933.892=0.115
σ0.013-0.005=0.008
min1933.989-1933.883=0.105
max1934.021-1933.896=0.125
mean2839.000-2620.000=219.000
σ0.000
min2839.000-2620.000=219.000
max2839.000-2620.000=219.000
mean2.994-3.035=-0.041
σ0.343-0.137=0.205
min2.632-2.820=-0.188
max3.446-3.158=0.288
iters=5
new-facts=6402
prior-facts=1
mean4754.664-4613.988=140.676
σ0.907-314.468=-313.561
min4753.950-4051.453=702.497
max4756.249-4756.134=0.115
mean2839.000-2620.000=219.000
σ0.000
min2839.000-2620.000=219.000
max2839.000-2620.000=219.000
mean8.509-8.081=0.429
σ0.541-0.725=-0.184
min7.617-7.000=0.617
max8.960-8.942=0.019
iters=5
new-facts=6402
prior-facts=6402
mean4945.224-4945.056=0.168
σ0.017-0.173=-0.156
min4945.208-4944.747=0.461
max4945.244-4945.160=0.084
mean3059.600-3014.000=45.600
σ189.629-378.325=-188.695
min2839.000-2620.000=219.000
max3325.000-3543.000=-218.000
mean8.605-8.815=-0.210
σ0.209-0.366=-0.157
min8.430-8.538=-0.108
max8.923-9.448=-0.525

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.101-1.286=-0.185
σ0.163-0.358=-0.195
min0.935-0.927=0.007
max1.375-1.739=-0.364

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.845-472.567=0.278
σ574.937-574.933=0.004
min185.365-185.096=0.269
max1335.250-1334.966=0.284
mean88.250
σ8.500
min84.000
max101.000
mean2839.000-2620.000=219.000
σ0.000
min2839.000-2620.000=219.000
max2839.000-2620.000=219.000
mean0.486-0.558=-0.072
σ0.378-0.534=-0.157
min0.295-0.289=0.006
max1.052-1.359=-0.307
policies=20
mean1854.024-1851.234=2.790
σ0.373-0.368=0.005
min1853.747-1850.985=2.762
max1854.566-1851.780=2.787
mean840.000
σ0.000
min840.000
max840.000
mean2839.000-2620.000=219.000
σ0.000
min2839.000-2620.000=219.000
max2839.000-2620.000=219.000
mean2.957-2.859=0.098
σ0.016-0.021=-0.004
min2.939-2.836=0.103
max2.977-2.877=0.100
policies=200
mean18546.613-18519.214=27.399
σ0.542-0.574=-0.032
min18546.129-18518.830=27.299
max18547.345-18520.056=27.289
mean8400.000
σ0.000
min8400.000
max8400.000
mean2839.000-2620.000=219.000
σ0.000
min2839.000-2620.000=219.000
max2839.000-2620.000=219.000
mean29.114-28.955=0.159
σ0.459-0.032=0.427
min28.854-28.925=-0.071
max29.802-28.998=0.804