Compare commits

Home / Compare 4cab834e .. 5788572e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.728-70.728=0.000
σ0.047-0.044=0.003
min70.703-70.701=0.002
max70.861-70.853=0.009
mean413.000
σ0.000
min413.000
max413.000
mean0.156-0.159=-0.003
σ0.006-0.005=0.001
min0.148-0.153=-0.005
max0.166-0.169=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.449-21.445=0.004
σ0.012-0.002=0.010
min21.442-21.440=0.003
max21.483-21.447=0.036
mean413.000
σ0.000
min413.000
max413.000
mean0.064-0.062=0.002
σ0.003-0.004=-0.000
min0.060-0.059=0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.525=0.002
σ0.360-0.361=-0.001
min1753.954-1753.955=-0.001
max1755.111-1755.111=0.000
mean1645.950-1654.600=-8.650
σ635.457-625.595=9.862
min639.000-625.000=14.000
max2855.000-2848.000=7.000
mean2.783-2.768=0.016
σ0.204-0.196=0.008
min2.330-2.317=0.013
max3.111-3.023=0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.610-273.612=-0.002
σ0.006-0.009=-0.003
min273.602-273.602=0.000
max273.616-273.624=-0.008
mean2855.000-2848.000=7.000
σ0.000
min2855.000-2848.000=7.000
max2855.000-2848.000=7.000
mean0.383-0.384=-0.001
σ0.004-0.001=0.002
min0.381-0.382=-0.001
max0.390-0.386=0.004
iters=5
new-facts=1
prior-facts=6402
mean1934.001-1933.999=0.002
σ0.006-0.007=-0.002
min1933.993-1933.988=0.005
max1934.006-1934.006=0.000
mean2855.000-2848.000=7.000
σ0.000
min2855.000-2848.000=7.000
max2855.000-2848.000=7.000
mean2.943-2.991=-0.048
σ0.184-0.058=0.127
min2.692-2.949=-0.257
max3.129-3.092=0.037
iters=5
new-facts=6402
prior-facts=1
mean4754.649-4754.790=-0.141
σ0.899-0.854=0.045
min4753.956-4754.343=-0.387
max4756.224-4756.314=-0.089
mean2855.000-2848.000=7.000
σ0.000
min2855.000-2848.000=7.000
max2855.000-2848.000=7.000
mean8.554-8.406=0.148
σ0.540-0.364=0.176
min7.661-7.982=-0.321
max8.933-8.739=0.193
iters=5
new-facts=6402
prior-facts=6402
mean4945.221-4945.226=-0.004
σ0.019-0.024=-0.005
min4945.197-4945.199=-0.003
max4945.243-4945.259=-0.017
mean3066.000-3046.600=19.400
σ222.741-204.925=17.816
min2855.000-2848.000=7.000
max3298.000-3335.000=-37.000
mean8.697-8.514=0.183
σ0.269-0.149=0.120
min8.366-8.368=-0.001
max9.070-8.727=0.343

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.084-1.050=0.034
σ0.113-0.129=-0.016
min0.944-0.932=0.011
max1.260-1.250=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.841-472.843=-0.002
σ574.930-574.929=0.001
min185.372-185.367=0.005
max1335.236-1335.236=-0.000
mean88.250
σ8.500
min84.000
max101.000
mean2855.000-2848.000=7.000
σ0.000
min2855.000-2848.000=7.000
max2855.000-2848.000=7.000
mean0.490-0.446=0.044
σ0.381-0.304=0.077
min0.297-0.290=0.007
max1.061-0.902=0.160
policies=20
mean1854.013-1854.015=-0.002
σ0.347-0.372=-0.025
min1853.774-1853.730=0.044
max1854.524-1854.552=-0.029
mean840.000
σ0.000
min840.000
max840.000
mean2855.000-2848.000=7.000
σ0.000
min2855.000-2848.000=7.000
max2855.000-2848.000=7.000
mean2.957-2.955=0.001
σ0.007-0.005=0.001
min2.950-2.948=0.002
max2.964-2.959=0.005
policies=200
mean18546.606-18546.579=0.027
σ0.506-0.579=-0.073
min18546.195-18546.218=-0.023
max18547.334-18547.443=-0.109
mean8400.000
σ0.000
min8400.000
max8400.000
mean2855.000-2848.000=7.000
σ0.000
min2855.000-2848.000=7.000
max2855.000-2848.000=7.000
mean29.139-29.258=-0.119
σ0.405-0.423=-0.018
min28.839-28.877=-0.039
max29.736-29.773=-0.036