Compare commits

Home / Compare 378ffd3c .. d7bd5056

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.569-70.566=0.003
σ0.045-0.045=0.000
min70.540-70.542=-0.002
max70.692-70.691=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.165-0.158=0.007
σ0.010-0.005=0.005
min0.154-0.151=0.002
max0.182-0.167=0.015
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.003=-0.001
min21.284-21.281=0.003
max21.291-21.291=-0.000
mean414.000-414.800=-0.800
σ0.000-0.422=-0.422
min414.000
max414.000-415.000=-1.000
mean0.065-0.062=0.003
σ0.003-0.005=-0.002
min0.063-0.058=0.005
max0.073-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.569=-0.001
σ0.362-0.360=0.002
min1752.995-1752.996=-0.001
max1754.169-1754.134=0.035
mean1669.050-1670.550=-1.500
σ628.132-632.690=-4.559
min688.000-687.000=1.000
max2768.000-2705.000=63.000
mean2.740-2.812=-0.072
σ0.201-0.170=0.031
min2.153-2.191=-0.038
max2.987-3.011=-0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.002-271.990=0.013
σ0.017-0.005=0.012
min271.988-271.985=0.003
max272.026-271.997=0.030
mean2768.000-2705.000=63.000
σ0.000
min2768.000-2705.000=63.000
max2768.000-2705.000=63.000
mean0.394-0.391=0.003
σ0.003-0.010=-0.007
min0.392-0.380=0.011
max0.400-0.404=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.437-1932.445=-0.008
σ0.014-0.008=0.006
min1932.427-1932.436=-0.009
max1932.461-1932.452=0.009
mean2768.000-2705.000=63.000
σ0.000
min2768.000-2705.000=63.000
max2768.000-2705.000=63.000
mean2.975-2.995=-0.020
σ0.172-0.091=0.081
min2.687-2.900=-0.212
max3.144-3.144=-0.000
iters=5
new-facts=6402
prior-facts=1
mean4753.151-4753.067=0.084
σ0.943-0.922=0.021
min4752.638-4752.150=0.488
max4754.832-4754.622=0.210
mean2768.000-2705.000=63.000
σ0.000
min2768.000-2705.000=63.000
max2768.000-2705.000=63.000
mean8.672-8.381=0.291
σ0.553-0.448=0.104
min7.872-7.621=0.250
max9.304-8.818=0.486
iters=5
new-facts=6402
prior-facts=6402
mean4943.630-4943.633=-0.004
σ0.017-0.024=-0.006
min4943.609-4943.609=-0.000
max4943.650-4943.665=-0.015
mean3034.200-3033.400=0.800
σ250.400-245.876=4.525
min2768.000-2705.000=63.000
max3376.000-3355.000=21.000
mean8.602-8.722=-0.119
σ0.183-0.396=-0.212
min8.417-8.418=-0.001
max8.853-9.300=-0.447

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.062-1.068=-0.006
σ0.129-0.192=-0.064
min0.946-0.919=0.027
max1.259-1.301=-0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.075-473.083=-0.008
σ575.922-575.924=-0.002
min185.110-185.110=0.000
max1336.958-1336.969=-0.011
mean88.250
σ8.500
min84.000
max101.000
mean2768.000-2705.000=63.000
σ0.000
min2768.000-2705.000=63.000
max2768.000-2705.000=63.000
mean0.450-0.574=-0.124
σ0.307-0.567=-0.260
min0.292-0.289=0.003
max0.910-1.424=-0.514
policies=20
mean1851.433-1851.410=0.023
σ0.335-0.384=-0.050
min1851.182-1851.153=0.029
max1851.923-1851.978=-0.055
mean840.000
σ0.000
min840.000
max840.000
mean2768.000-2705.000=63.000
σ0.000
min2768.000-2705.000=63.000
max2768.000-2705.000=63.000
mean2.910-2.865=0.045
σ0.092-0.015=0.077
min2.845-2.850=-0.005
max3.045-2.878=0.167
policies=200
mean18520.915-18520.999=-0.084
σ0.473-0.435=0.038
min18520.592-18520.765=-0.173
max18521.608-18521.651=-0.043
mean8400.000
σ0.000
min8400.000
max8400.000
mean2768.000-2705.000=63.000
σ0.000
min2768.000-2705.000=63.000
max2768.000-2705.000=63.000
mean28.800-28.948=-0.148
σ0.107-0.090=0.017
min28.691-28.826=-0.134
max28.947-29.043=-0.096