Compare commits

Home / Compare c661d773 .. 1e8a264c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.684-70.691=-0.007
σ0.044-0.048=-0.004
min70.658-70.658=-0.001
max70.808-70.826=-0.018
mean410.000-416.000=-6.000
σ0.000
min410.000-416.000=-6.000
max410.000-416.000=-6.000
mean0.160-0.161=-0.001
σ0.003-0.004=-0.001
min0.157-0.158=-0.001
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.420-21.420=0.001
σ0.003-0.003=-0.000
min21.416-21.416=0.000
max21.424-21.425=-0.001
mean410.000-416.000=-6.000
σ0.000
min410.000-416.000=-6.000
max410.000-416.000=-6.000
mean0.063-0.064=-0.001
σ0.003-0.004=-0.001
min0.059-0.058=0.001
max0.069-0.074=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.458=-0.000
σ0.359-0.360=-0.001
min1753.889-1753.881=0.009
max1755.033-1755.039=-0.006
mean1648.200-1670.850=-22.650
σ640.716-628.866=11.850
min648.000-664.000=-16.000
max2871.000-2620.000=251.000
mean2.825-2.800=0.024
σ0.131-0.126=0.005
min2.556-2.412=0.144
max3.053-2.927=0.126

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.505-273.501=0.004
σ0.008-0.005=0.003
min273.497-273.493=0.004
max273.519-273.506=0.013
mean2871.000-2620.000=251.000
σ0.000
min2871.000-2620.000=251.000
max2871.000-2620.000=251.000
mean0.387-0.378=0.009
σ0.003-0.004=-0.001
min0.385-0.376=0.009
max0.392-0.386=0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.897-1933.892=0.005
σ0.009-0.005=0.004
min1933.886-1933.883=0.003
max1933.906-1933.896=0.010
mean2871.000-2620.000=251.000
σ0.000
min2871.000-2620.000=251.000
max2871.000-2620.000=251.000
mean3.002-3.035=-0.033
σ0.147-0.137=0.010
min2.787-2.820=-0.034
max3.188-3.158=0.030
iters=5
new-facts=6402
prior-facts=1
mean4754.739-4613.988=140.750
σ0.792-314.468=-313.677
min4754.335-4051.453=702.882
max4756.154-4756.134=0.019
mean2871.000-2620.000=251.000
σ0.000
min2871.000-2620.000=251.000
max2871.000-2620.000=251.000
mean7.980-8.081=-0.100
σ0.256-0.725=-0.469
min7.839-7.000=0.839
max8.435-8.942=-0.507
iters=5
new-facts=6402
prior-facts=6402
mean4945.112-4945.056=0.056
σ0.014-0.173=-0.159
min4945.090-4944.747=0.342
max4945.124-4945.160=-0.035
mean3041.600-3014.000=27.600
σ253.416-378.325=-124.908
min2871.000-2620.000=251.000
max3449.000-3543.000=-94.000
mean8.432-8.815=-0.383
σ0.069-0.366=-0.297
min8.327-8.538=-0.211
max8.498-9.448=-0.950

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.077-1.286=-0.209
σ0.238-0.358=-0.121
min0.936-0.927=0.009
max1.488-1.739=-0.250

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.574-472.567=0.007
σ574.939-574.933=0.006
min185.093-185.096=-0.003
max1334.983-1334.966=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2871.000-2620.000=251.000
σ0.000
min2871.000-2620.000=251.000
max2871.000-2620.000=251.000
mean0.450-0.558=-0.107
σ0.312-0.534=-0.223
min0.280-0.289=-0.009
max0.918-1.359=-0.441
policies=20
mean1851.271-1851.234=0.038
σ0.378-0.368=0.010
min1850.988-1850.985=0.002
max1851.822-1851.780=0.042
mean840.000
σ0.000
min840.000
max840.000
mean2871.000-2620.000=251.000
σ0.000
min2871.000-2620.000=251.000
max2871.000-2620.000=251.000
mean2.954-2.859=0.094
σ0.011-0.021=-0.010
min2.940-2.836=0.104
max2.966-2.877=0.089
policies=200
mean18519.474-18519.214=0.260
σ0.489-0.574=-0.084
min18519.183-18518.830=0.353
max18520.207-18520.056=0.150
mean8400.000
σ0.000
min8400.000
max8400.000
mean2871.000-2620.000=251.000
σ0.000
min2871.000-2620.000=251.000
max2871.000-2620.000=251.000
mean29.253-28.955=0.298
σ0.405-0.032=0.373
min28.954-28.925=0.029
max29.820-28.998=0.822