Compare commits

Home / Compare 7a70ae90 .. 892ea65f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.774-70.731=0.043
σ0.047-0.046=0.001
min70.745-70.707=0.038
max70.907-70.860=0.047
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.157-0.160=-0.003
σ0.005-0.004=0.001
min0.152-0.154=-0.003
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.491-21.465=0.027
σ0.003-0.003=-0.000
min21.486-21.460=0.026
max21.496-21.471=0.026
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.065-0.063=0.002
σ0.002-0.004=-0.001
min0.063-0.060=0.003
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.526-1754.459=0.068
σ0.361-0.360=0.001
min1753.951-1753.889=0.062
max1755.111-1755.044=0.067
mean1656.400-1651.100=5.300
σ626.742-621.234=5.508
min625.000-632.000=-7.000
max2852.000-2647.000=205.000
mean2.822-2.823=-0.001
σ0.142-0.245=-0.102
min2.311-2.136=0.176
max2.981-3.181=-0.200

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.607-273.498=0.109
σ0.007-0.006=0.001
min273.600-273.493=0.107
max273.616-273.508=0.108
mean2852.000-2647.000=205.000
σ0.000
min2852.000-2647.000=205.000
max2852.000-2647.000=205.000
mean0.390-0.383=0.007
σ0.009-0.005=0.004
min0.382-0.380=0.003
max0.400-0.391=0.008
iters=5
new-facts=1
prior-facts=6402
mean1934.009-1933.893=0.116
σ0.012-0.005=0.007
min1933.999-1933.886=0.113
max1934.029-1933.899=0.130
mean2852.000-2647.000=205.000
σ0.000
min2852.000-2647.000=205.000
max2852.000-2647.000=205.000
mean3.114-2.967=0.147
σ0.327-0.212=0.115
min2.753-2.698=0.055
max3.617-3.192=0.425
iters=5
new-facts=6402
prior-facts=1
mean4754.760-4754.406=0.355
σ0.841-0.757=0.084
min4754.294-4753.616=0.678
max4756.257-4755.661=0.596
mean2852.000-2647.000=205.000
σ0.000
min2852.000-2647.000=205.000
max2852.000-2647.000=205.000
mean8.509-8.705=-0.195
σ0.533-0.280=0.253
min7.628-8.379=-0.750
max8.994-8.963=0.031
iters=5
new-facts=6402
prior-facts=6402
mean4945.223-4945.121=0.102
σ0.021-0.014=0.007
min4945.203-4945.105=0.097
max4945.247-4945.136=0.111
mean3054.000-3008.400=45.600
σ203.701-265.586=-61.885
min2852.000-2647.000=205.000
max3330.000-3306.000=24.000
mean8.600-8.576=0.024
σ0.177-0.160=0.017
min8.397-8.402=-0.005
max8.807-8.735=0.071

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.072-1.169=-0.098
σ0.219-0.376=-0.157
min0.943-0.928=0.015
max1.452-1.799=-0.347

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.841-472.572=0.269
σ574.936-574.949=-0.013
min185.368-185.093=0.275
max1335.245-1334.995=0.250
mean88.250
σ8.500
min84.000
max101.000
mean2852.000-2647.000=205.000
σ0.000
min2852.000-2647.000=205.000
max2852.000-2647.000=205.000
mean0.455-0.568=-0.113
σ0.309-0.559=-0.250
min0.299-0.287=0.012
max0.918-1.406=-0.488
policies=20
mean1854.001-1851.239=2.762
σ0.380-0.373=0.008
min1853.714-1850.989=2.725
max1854.552-1851.790=2.762
mean840.000
σ0.000
min840.000
max840.000
mean2852.000-2647.000=205.000
σ0.000
min2852.000-2647.000=205.000
max2852.000-2647.000=205.000
mean2.972-2.849=0.123
σ0.010-0.010=0.000
min2.962-2.843=0.120
max2.984-2.864=0.120
policies=200
mean18546.628-18519.353=27.274
σ0.387-0.395=-0.008
min18546.312-18519.009=27.303
max18547.192-18519.918=27.274
mean8400.000
σ0.000
min8400.000
max8400.000
mean2852.000-2647.000=205.000
σ0.000
min2852.000-2647.000=205.000
max2852.000-2647.000=205.000
mean29.374-28.868=0.506
σ0.509-0.043=0.466
min28.880-28.813=0.067
max29.930-28.916=1.014