Compare commits

Home / Compare d2ef5bf8 .. 49b3cb17

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.567=-0.001
σ0.044-0.047=-0.003
min70.543-70.540=0.002
max70.686-70.695=-0.009
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.160-0.159=0.001
σ0.003-0.003=-0.000
min0.156-0.156=0.000
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.001
σ0.003-0.003=-0.000
min21.284-21.282=0.002
max21.294-21.291=0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.064-0.062=0.002
σ0.002-0.005=-0.002
min0.063-0.058=0.005
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1753.373=-0.001
σ0.363-0.360=0.003
min1752.799-1752.801=-0.002
max1753.955-1753.972=-0.017
mean1650.800-1660.750=-9.950
σ644.869-634.762=10.107
min635.000-620.000=15.000
max2899.000-2806.000=93.000
mean2.769-2.815=-0.045
σ0.215-0.118=0.098
min2.277-2.531=-0.254
max3.000-3.088=-0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.757-271.756=0.001
σ0.004-0.007=-0.003
min271.751-271.746=0.004
max271.761-271.765=-0.003
mean2899.000-2806.000=93.000
σ0.000
min2899.000-2806.000=93.000
max2899.000-2806.000=93.000
mean0.381-0.387=-0.006
σ0.009-0.005=0.004
min0.372-0.382=-0.010
max0.396-0.394=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.174-1932.175=-0.001
σ0.013-0.014=-0.001
min1932.163-1932.155=0.008
max1932.190-1932.189=0.001
mean2899.000-2806.000=93.000
σ0.000
min2899.000-2806.000=93.000
max2899.000-2806.000=93.000
mean2.958-2.948=0.010
σ0.097-0.106=-0.009
min2.816-2.811=0.005
max3.078-3.094=-0.016
iters=5
new-facts=6402
prior-facts=1
mean4752.755-4752.905=-0.150
σ1.049-0.891=0.157
min4751.809-4752.439=-0.631
max4754.560-4754.491=0.069
mean2899.000-2806.000=93.000
σ0.000
min2899.000-2806.000=93.000
max2899.000-2806.000=93.000
mean8.833-8.461=0.372
σ0.226-0.544=-0.318
min8.502-7.612=0.890
max9.132-8.859=0.274
iters=5
new-facts=6402
prior-facts=6402
mean4943.307-4943.369=-0.062
σ0.152-0.019=0.132
min4943.038-4943.346=-0.308
max4943.394-4943.386=0.008
mean3039.000-3003.000=36.000
σ169.037-259.987=-90.950
min2899.000-2806.000=93.000
max3313.000-3402.000=-89.000
mean8.555-8.397=0.158
σ0.142-0.043=0.099
min8.420-8.342=0.078
max8.781-8.443=0.338

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.078-1.021=0.057
σ0.177-0.143=0.035
min0.936-0.927=0.008
max1.371-1.257=0.114

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.862-467.858=0.004
σ575.931-575.929=0.002
min179.890-179.887=0.004
max1331.758-1331.752=0.006
mean86.250
σ8.500
min82.000
max99.000
mean2899.000-2806.000=93.000
σ0.000
min2899.000-2806.000=93.000
max2899.000-2806.000=93.000
mean0.443-0.469=-0.026
σ0.309-0.370=-0.061
min0.288-0.282=0.006
max0.906-1.023=-0.117
policies=20
mean1799.180-1799.147=0.033
σ0.377-0.358=0.019
min1798.909-1798.900=0.009
max1799.733-1799.678=0.055
mean820.000
σ0.000
min820.000
max820.000
mean2899.000-2806.000=93.000
σ0.000
min2899.000-2806.000=93.000
max2899.000-2806.000=93.000
mean2.902-2.801=0.101
σ0.020-0.008=0.012
min2.884-2.795=0.089
max2.929-2.813=0.116
policies=200
mean17998.550-17998.387=0.163
σ0.446-0.427=0.019
min17998.267-17998.078=0.189
max17999.214-17999.010=0.204
mean8200.000
σ0.000
min8200.000
max8200.000
mean2899.000-2806.000=93.000
σ0.000
min2899.000-2806.000=93.000
max2899.000-2806.000=93.000
mean28.688-28.190=0.498
σ0.420-0.076=0.344
min28.214-28.125=0.089
max29.095-28.295=0.800