Compare commits

Home / Compare 4fdf4f20 .. 888f28ef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.388-70.389=-0.001
σ0.044-0.045=-0.000
min70.360-70.363=-0.003
max70.512-70.513=-0.001
mean414.000-415.400=-1.400
σ0.000-0.699=-0.699
min414.000
max414.000-416.000=-2.000
mean0.160-0.159=0.000
σ0.003-0.003=0.000
min0.154-0.156=-0.003
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.003-0.002=0.001
min21.138-21.141=-0.003
max21.149-21.147=0.002
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.062-0.062=-0.001
σ0.004-0.004=-0.001
min0.057-0.058=-0.001
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.396=-0.001
σ0.362-0.360=0.002
min1751.828-1751.826=0.001
max1752.982-1752.983=-0.001
mean1642.850-1658.350=-15.500
σ630.101-631.146=-1.046
min616.000-626.000=-10.000
max2801.000-2774.000=27.000
mean2.851-2.869=-0.018
σ0.154-0.118=0.036
min2.409-2.474=-0.066
max3.076-3.055=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.143-270.141=0.002
σ0.008-0.014=-0.005
min270.131-270.128=0.003
max270.153-270.162=-0.010
mean2801.000-2774.000=27.000
σ0.000
min2801.000-2774.000=27.000
max2801.000-2774.000=27.000
mean0.385-0.384=0.001
σ0.012-0.016=-0.003
min0.371-0.372=-0.002
max0.398-0.411=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1930.609-1930.612=-0.002
σ0.004-0.006=-0.001
min1930.604-1930.603=0.001
max1930.615-1930.617=-0.002
mean2801.000-2774.000=27.000
σ0.000
min2801.000-2774.000=27.000
max2801.000-2774.000=27.000
mean2.485-2.577=-0.092
σ0.076-0.086=-0.010
min2.430-2.491=-0.061
max2.598-2.668=-0.071
iters=5
new-facts=6402
prior-facts=1
mean4751.321-4751.204=0.116
σ0.914-0.972=-0.059
min4750.809-4750.360=0.449
max4752.945-4752.878=0.067
mean2801.000-2774.000=27.000
σ0.000
min2801.000-2774.000=27.000
max2801.000-2774.000=27.000
mean8.478-8.465=0.012
σ0.514-0.509=0.005
min7.661-7.642=0.019
max9.005-9.031=-0.026
iters=5
new-facts=6402
prior-facts=6402
mean4941.773-4941.773=0.000
σ0.013-0.022=-0.008
min4941.758-4941.745=0.012
max4941.788-4941.800=-0.012
mean3025.200-3074.400=-49.200
σ225.690-292.852=-67.162
min2801.000-2774.000=27.000
max3330.000-3364.000=-34.000
mean8.508-8.647=-0.138
σ0.254-0.193=0.060
min8.314-8.431=-0.118
max8.922-8.926=-0.004

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.054-1.031=0.022
σ0.123-0.147=-0.025
min0.941-0.936=0.005
max1.241-1.279=-0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.379-466.376=0.002
σ575.943-575.927=0.016
min178.401-178.405=-0.004
max1330.292-1330.266=0.026
mean84.250
σ8.500
min80.000
max97.000
mean2801.000-2774.000=27.000
σ0.000
min2801.000-2774.000=27.000
max2801.000-2774.000=27.000
mean0.480-0.444=0.037
σ0.380-0.305=0.075
min0.287-0.285=0.002
max1.051-0.902=0.149
policies=20
mean1784.331-1784.320=0.012
σ0.342-0.309=0.033
min1784.109-1784.098=0.011
max1784.837-1784.769=0.068
mean800.000
σ0.000
min800.000
max800.000
mean2801.000-2774.000=27.000
σ0.000
min2801.000-2774.000=27.000
max2801.000-2774.000=27.000
mean2.867-2.824=0.042
σ0.078-0.101=-0.023
min2.774-2.757=0.017
max2.965-2.974=-0.009
policies=200
mean17849.783-17849.777=0.006
σ0.581-0.430=0.151
min17849.367-17849.477=-0.110
max17850.632-17850.416=0.216
mean8000.000
σ0.000
min8000.000
max8000.000
mean2801.000-2774.000=27.000
σ0.000
min2801.000-2774.000=27.000
max2801.000-2774.000=27.000
mean28.001-28.055=-0.054
σ0.125-0.170=-0.045
min27.888-27.940=-0.052
max28.177-28.300=-0.123