Compare commits

Home / Compare 1026bb65 .. 6f541f74

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.782=-0.002
σ0.044-0.047=-0.003
min70.749-70.755=-0.005
max70.902-70.914=-0.012
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.157-0.162=-0.005
σ0.005-0.004=0.002
min0.150-0.158=-0.009
max0.168-0.168=0.000
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.003-0.003=-0.000
min21.488-21.489=-0.001
max21.498-21.498=0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.066=-0.001
σ0.002-0.004=-0.001
min0.063-0.061=0.002
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.093=0.000
σ0.362-0.361=0.000
min1753.527-1753.522=0.005
max1754.676-1754.677=-0.002
mean1657.400-1662.150=-4.750
σ631.064-635.647=-4.583
min627.000-628.000=-1.000
max2709.000-2778.000=-69.000
mean2.827-2.804=0.023
σ0.177-0.199=-0.022
min2.441-2.162=0.280
max3.110-3.078=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.957-271.955=0.002
σ0.004-0.005=-0.001
min271.954-271.950=0.004
max271.965-271.964=0.001
mean2709.000-2778.000=-69.000
σ0.000
min2709.000-2778.000=-69.000
max2709.000-2778.000=-69.000
mean0.385-0.381=0.004
σ0.009-0.008=0.001
min0.380-0.377=0.003
max0.402-0.396=0.006
iters=5
new-facts=1
prior-facts=6402
mean1792.062-1932.322=-140.260
σ313.645-0.019=313.626
min1230.997-1932.301=-701.304
max1932.366-1932.344=0.022
mean2709.000-2778.000=-69.000
σ0.000
min2709.000-2778.000=-69.000
max2709.000-2778.000=-69.000
mean2.788-2.992=-0.203
σ0.593-0.057=0.535
min1.735-2.898=-1.163
max3.153-3.055=0.099
iters=5
new-facts=6402
prior-facts=1
mean4753.081-4753.080=0.000
σ0.912-0.899=0.013
min4752.544-4752.607=-0.063
max4754.692-4754.678=0.014
mean2709.000-2778.000=-69.000
σ0.000
min2709.000-2778.000=-69.000
max2709.000-2778.000=-69.000
mean8.681-8.575=0.107
σ0.465-0.446=0.019
min8.044-7.987=0.057
max9.196-8.945=0.251
iters=5
new-facts=6402
prior-facts=6402
mean4943.481-4943.563=-0.082
σ0.166-0.012=0.154
min4943.185-4943.544=-0.360
max4943.573-4943.572=0.001
mean2937.800-2991.800=-54.000
σ292.709-212.757=79.952
min2709.000-2778.000=-69.000
max3382.000-3304.000=78.000
mean8.427-8.591=-0.164
σ0.071-0.209=-0.137
min8.345-8.394=-0.049
max8.512-8.922=-0.410

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.989-1.018=-0.029
σ0.144-0.133=0.011
min0.916-0.931=-0.015
max1.246-1.237=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.666-468.665=0.001
σ574.939-574.924=0.015
min181.189-181.197=-0.008
max1331.075-1331.051=0.023
mean88.250
σ8.500
min84.000
max101.000
mean2709.000-2778.000=-69.000
σ0.000
min2709.000-2778.000=-69.000
max2709.000-2778.000=-69.000
mean0.555-0.451=0.103
σ0.535-0.307=0.228
min0.285-0.295=-0.010
max1.357-0.912=0.445
policies=20
mean1812.213-1812.246=-0.033
σ0.384-0.387=-0.003
min1811.955-1811.971=-0.016
max1812.782-1812.812=-0.030
mean840.000
σ0.000
min840.000
max840.000
mean2709.000-2778.000=-69.000
σ0.000
min2709.000-2778.000=-69.000
max2709.000-2778.000=-69.000
mean2.842-2.940=-0.099
σ0.011-0.049=-0.038
min2.827-2.912=-0.086
max2.852-3.013=-0.161
policies=200
mean18129.224-18129.083=0.140
σ0.504-0.650=-0.145
min18128.929-18128.680=0.250
max18129.979-18130.054=-0.075
mean8400.000
σ0.000
min8400.000
max8400.000
mean2709.000-2778.000=-69.000
σ0.000
min2709.000-2778.000=-69.000
max2709.000-2778.000=-69.000
mean28.594-28.544=0.050
σ0.111-0.066=0.045
min28.484-28.451=0.033
max28.741-28.600=0.141