Compare commits

Home / Compare cd020e8e .. 08c42aad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.034-73.027=0.007
σ0.044-0.047=-0.003
min73.005-72.995=0.009
max73.155-73.157=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.162-0.163=-0.001
σ0.003-0.003=0.000
min0.160-0.160=-0.001
max0.168-0.168=0.000
cache=y
dps=1
iters=10
policies=100
mean23.732-23.724=0.008
σ0.004-0.002=0.002
min23.726-23.722=0.004
max23.739-23.728=0.010
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.063-0.064=-0.000
σ0.003-0.003=-0.001
min0.060-0.060=0.000
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.785=0.003
σ0.360-0.359=0.001
min1758.218-1758.209=0.010
max1759.371-1759.367=0.003
mean1644.700-1662.800=-18.100
σ625.269-626.617=-1.347
min619.000-626.000=-7.000
max2774.000-2521.000=253.000
mean2.864-2.843=0.021
σ0.184-0.108=0.076
min2.576-2.571=0.004
max3.397-3.039=0.358

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.012-324.012=0.000
σ0.054-0.055=-0.001
min323.917-323.914=0.002
max324.044-324.040=0.004
mean2774.000-2521.000=253.000
σ0.000
min2774.000-2521.000=253.000
max2774.000-2521.000=253.000
mean0.427-0.431=-0.004
σ0.002-0.007=-0.005
min0.424-0.425=-0.001
max0.429-0.441=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1984.582-1984.587=-0.004
σ0.019-0.025=-0.006
min1984.560-1984.554=0.006
max1984.609-1984.613=-0.004
mean2774.000-2521.000=253.000
σ0.000
min2774.000-2521.000=253.000
max2774.000-2521.000=253.000
mean2.649-2.604=0.045
σ0.091-0.062=0.029
min2.574-2.551=0.023
max2.755-2.701=0.055
iters=5
new-facts=6402
prior-facts=1
mean4808.173-4808.123=0.050
σ7.797-7.851=-0.054
min4804.195-4804.112=0.083
max4822.109-4822.157=-0.047
mean2774.000-2521.000=253.000
σ0.000
min2774.000-2521.000=253.000
max2774.000-2521.000=253.000
mean8.870-8.837=0.032
σ0.581-0.258=0.323
min7.991-8.590=-0.599
max9.536-9.162=0.374
iters=5
new-facts=6402
prior-facts=6402
mean4995.655-4995.800=-0.145
σ0.181-0.020=0.161
min4995.451-4995.775=-0.325
max4995.797-4995.822=-0.024
mean3052.200-2970.600=81.600
σ346.615-263.285=83.331
min2774.000-2638.000=136.000
max3576.000-3323.000=253.000
mean8.568-8.538=0.029
σ0.165-0.079=0.086
min8.405-8.432=-0.026
max8.777-8.640=0.137

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.982-1.610=-0.628
σ0.144-0.267=-0.123
min0.913-1.240=-0.328
max1.238-1.828=-0.589

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.347-468.321=0.026
σ574.230-574.233=-0.003
min181.223-181.199=0.024
max1329.692-1329.671=0.021
mean88.250
σ8.500
min84.000
max101.000
mean2774.000-2521.000=253.000
σ0.000
min2774.000-2521.000=253.000
max2774.000-2521.000=253.000
mean0.482-0.566=-0.084
σ0.379-0.566=-0.187
min0.290-0.280=0.010
max1.051-1.416=-0.365
policies=20
mean1812.591-1812.385=0.205
σ0.394-0.398=-0.004
min1812.317-1812.104=0.213
max1813.171-1812.969=0.202
mean840.000
σ0.000
min840.000
max840.000
mean2774.000-2521.000=253.000
σ0.000
min2774.000-2521.000=253.000
max2774.000-2521.000=253.000
mean2.884-2.843=0.041
σ0.007-0.045=-0.039
min2.879-2.799=0.079
max2.893-2.901=-0.008
policies=200
mean18131.453-18131.287=0.166
σ0.503-0.539=-0.036
min18131.118-18130.901=0.217
max18132.194-18132.069=0.125
mean8400.000
σ0.000
min8400.000
max8400.000
mean2774.000-2521.000=253.000
σ0.000
min2774.000-2521.000=253.000
max2774.000-2521.000=253.000
mean28.373-28.322=0.051
σ0.241-0.100=0.140
min28.092-28.181=-0.089
max28.671-28.418=0.253