Compare commits

Home / Compare 4ac68779 .. 052fa513

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.049-73.045=0.004
σ0.046-0.048=-0.002
min73.017-73.021=-0.004
max73.176-73.179=-0.003
mean418.000-414.000=4.000
σ1.054-0.000=1.054
min417.000-414.000=3.000
max419.000-414.000=5.000
mean0.168-0.161=0.007
σ0.008-0.004=0.004
min0.161-0.158=0.003
max0.187-0.168=0.019
cache=y
dps=1
iters=10
policies=100
mean23.740-23.739=0.002
σ0.002-0.003=-0.001
min23.738-23.733=0.005
max23.747-23.743=0.003
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.066-0.061=0.005
σ0.003-0.002=0.001
min0.064-0.060=0.005
max0.074-0.066=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1758.787=-0.001
σ0.359-0.360=-0.002
min1758.218-1758.210=0.008
max1759.368-1759.363=0.004
mean1656.400-1663.350=-6.950
σ621.547-626.219=-4.671
min634.000-627.000=7.000
max2506.000-2525.000=-19.000
mean2.732-2.798=-0.066
σ0.270-0.201=0.069
min2.157-2.150=0.007
max3.112-3.198=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.012-324.015=-0.003
σ0.053-0.055=-0.002
min323.918-323.917=0.001
max324.041-324.044=-0.004
mean2506.000-2525.000=-19.000
σ0.000
min2506.000-2525.000=-19.000
max2506.000-2525.000=-19.000
mean0.426-0.427=-0.001
σ0.002-0.001=0.001
min0.424-0.426=-0.001
max0.428-0.428=0.000
iters=5
new-facts=1
prior-facts=6402
mean1984.580-1984.596=-0.016
σ0.015-0.012=0.003
min1984.565-1984.574=-0.010
max1984.599-1984.604=-0.005
mean2506.000-2525.000=-19.000
σ0.000
min2506.000-2525.000=-19.000
max2506.000-2525.000=-19.000
mean2.608-2.652=-0.044
σ0.123-0.143=-0.020
min2.444-2.500=-0.056
max2.769-2.879=-0.110
iters=5
new-facts=6402
prior-facts=1
mean4808.191-4808.116=0.076
σ7.814-7.812=0.002
min4804.145-4804.196=-0.051
max4822.156-4822.083=0.073
mean2506.000-2525.000=-19.000
σ0.000
min2506.000-2525.000=-19.000
max2506.000-2525.000=-19.000
mean8.498-8.676=-0.178
σ0.486-0.262=0.224
min7.928-8.427=-0.498
max9.020-9.064=-0.044
iters=5
new-facts=6402
prior-facts=6402
mean4995.805-4995.808=-0.003
σ0.019-0.019=0.000
min4995.783-4995.788=-0.006
max4995.819-4995.828=-0.008
mean2941.000-3005.000=-64.000
σ307.335-308.021=-0.687
min2506.000-2601.000=-95.000
max3324.000-3394.000=-70.000
mean8.556-8.610=-0.054
σ0.046-0.150=-0.104
min8.479-8.410=0.068
max8.596-8.757=-0.161

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.795-1.568=0.227
σ0.072-0.242=-0.170
min1.682-1.252=0.430
max1.860-1.822=0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.323-468.327=-0.004
σ574.228-574.237=-0.009
min181.207-181.208=-0.001
max1329.665-1329.682=-0.017
mean88.250
σ8.500
min84.000
max101.000
mean2506.000-2525.000=-19.000
σ0.000
min2506.000-2525.000=-19.000
max2506.000-2525.000=-19.000
mean0.537-0.561=-0.024
σ0.510-0.556=-0.046
min0.281-0.280=0.001
max1.301-1.394=-0.093
policies=20
mean1812.409-1812.435=-0.025
σ0.392-0.388=0.003
min1812.149-1812.178=-0.030
max1812.988-1813.010=-0.022
mean840.000
σ0.000
min840.000
max840.000
mean2506.000-2525.000=-19.000
σ0.000
min2506.000-2525.000=-19.000
max2506.000-2525.000=-19.000
mean2.817-2.813=0.004
σ0.016-0.008=0.009
min2.799-2.805=-0.007
max2.831-2.822=0.009
policies=200
mean18131.563-18131.686=-0.123
σ0.402-0.460=-0.058
min18131.295-18131.418=-0.123
max18132.157-18132.374=-0.217
mean8400.000
σ0.000
min8400.000
max8400.000
mean2506.000-2525.000=-19.000
σ0.000
min2506.000-2525.000=-19.000
max2506.000-2525.000=-19.000
mean28.436-28.346=0.089
σ0.046-0.041=0.005
min28.378-28.315=0.063
max28.480-28.407=0.073