Compare commits

Home / Compare b5a6eb29 .. 97ee3c2d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=-0.001
σ0.048-0.046=0.002
min70.743-70.748=-0.005
max70.913-70.910=0.003
mean415.000-413.900=1.100
σ0.000-0.316=-0.316
min415.000-413.000=2.000
max415.000-414.000=1.000
mean0.158-0.160=-0.002
σ0.005-0.003=0.002
min0.152-0.157=-0.005
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.000
σ0.003-0.003=0.001
min21.488-21.487=0.001
max21.498-21.497=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.064-0.063=0.002
σ0.005-0.003=0.001
min0.060-0.059=0.001
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.094=-0.000
σ0.360-0.358=0.002
min1753.531-1753.534=-0.003
max1754.685-1754.675=0.010
mean1663.800-1663.600=0.200
σ632.997-636.478=-3.482
min630.000-625.000=5.000
max2780.000
mean2.773-2.803=-0.030
σ0.240-0.146=0.094
min2.181-2.441=-0.260
max3.097-3.085=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.952-271.953=-0.001
σ0.006-0.004=0.001
min271.944-271.949=-0.004
max271.960-271.959=0.001
mean2780.000
σ0.000
min2780.000
max2780.000
mean0.379-0.383=-0.004
σ0.002-0.008=-0.006
min0.376-0.377=-0.001
max0.381-0.396=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1932.315-1932.329=-0.014
σ0.012-0.015=-0.003
min1932.299-1932.313=-0.015
max1932.329-1932.353=-0.023
mean2780.000
σ0.000
min2780.000
max2780.000
mean3.018-2.968=0.051
σ0.077-0.191=-0.114
min2.910-2.657=0.253
max3.115-3.182=-0.066
iters=5
new-facts=6402
prior-facts=1
mean4753.101-4753.107=-0.006
σ0.947-0.894=0.053
min4752.517-4752.570=-0.053
max4754.781-4754.688=0.092
mean2780.000
σ0.000
min2780.000
max2780.000
mean8.585-8.411=0.175
σ0.520-0.541=-0.021
min7.939-7.701=0.239
max9.284-8.931=0.353
iters=5
new-facts=6402
prior-facts=6402
mean4943.559-4943.492=0.067
σ0.016-0.147=-0.131
min4943.544-4943.229=0.315
max4943.578-4943.562=0.016
mean2999.400-3024.200=-24.800
σ222.564-227.928=-5.364
min2780.000
max3323.000-3330.000=-7.000
mean8.556-8.615=-0.059
σ0.094-0.230=-0.137
min8.436-8.411=0.025
max8.670-8.879=-0.208

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.008-0.986=0.022
σ0.122-0.117=0.005
min0.927-0.926=0.000
max1.204-1.194=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.659-468.660=-0.001
σ574.925-574.932=-0.007
min181.188-181.188=-0.001
max1331.047-1331.059=-0.012
mean88.250
σ8.500
min84.000
max101.000
mean2780.000
σ0.000
min2780.000
max2780.000
mean0.448-0.443=0.005
σ0.309-0.300=0.009
min0.291-0.292=-0.001
max0.911-0.892=0.019
policies=20
mean1812.217-1812.215=0.002
σ0.367-0.371=-0.004
min1811.943-1811.938=0.006
max1812.743-1812.747=-0.004
mean840.000
σ0.000
min840.000
max840.000
mean2780.000
σ0.000
min2780.000
max2780.000
mean2.928-2.937=-0.009
σ0.089-0.107=-0.018
min2.836-2.836=0.000
max3.050-3.088=-0.038
policies=200
mean18129.201-18129.078=0.123
σ0.552-0.391=0.161
min18128.809-18128.679=0.130
max18130.020-18129.615=0.405
mean8400.000
σ0.000
min8400.000
max8400.000
mean2780.000
σ0.000
min2780.000
max2780.000
mean28.696-28.627=0.069
σ0.141-0.080=0.062
min28.544-28.550=-0.006
max28.882-28.739=0.143