Compare commits

Home / Compare 0c50b719 .. 6874db8f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.000
σ0.368-0.368=-0.000
min53.778-53.784=-0.005
max54.960-54.961=-0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.140-0.139=0.000
σ0.003-0.004=-0.001
min0.136-0.134=0.003
max0.145-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.140=0.001
σ0.006-0.007=-0.001
min43.133-43.129=0.003
max43.152-43.150=0.003
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.119-0.120=-0.001
σ0.004-0.004=-0.000
min0.113-0.115=-0.002
max0.125-0.128=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.819-991.805=0.014
σ1.243-1.242=0.001
min991.228-991.253=-0.025
max997.041-997.033=0.007
mean1068.000-1067.200=0.800
σ313.182-322.244=-9.062
min616.000-571.000=45.000
max1645.000-1642.000=3.000
mean1.526-1.530=-0.004
σ0.075-0.066=0.009
min1.382-1.480=-0.098
max1.677-1.743=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.411=-0.001
σ0.010-0.010=-0.000
min285.392-285.395=-0.003
max285.417-285.419=-0.002
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.381-0.375=0.006
σ0.008-0.001=0.007
min0.374-0.373=0.001
max0.390-0.376=0.014
iters=5
new-facts=1
prior-facts=6402
mean1285.372-1285.377=-0.005
σ0.131-0.141=-0.010
min1285.307-1285.308=-0.001
max1285.607-1285.629=-0.022
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean1.882-1.851=0.030
σ0.104-0.038=0.066
min1.804-1.814=-0.010
max2.058-1.905=0.152
iters=5
new-facts=6402
prior-facts=1
mean1807.724-1807.674=0.050
σ6.995-7.020=-0.024
min1804.402-1804.328=0.074
max1820.224-1820.216=0.009
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean4.226-4.075=0.150
σ0.171-0.164=0.006
min3.983-3.971=0.012
max4.401-4.362=0.039
iters=5
new-facts=6402
prior-facts=6402
mean2070.194-2070.194=0.001
σ0.009-0.011=-0.002
min2070.185-2070.182=0.002
max2070.209-2070.212=-0.002
mean1860.200-1853.600=6.600
σ198.733-174.892=23.840
min1645.000-1642.000=3.000
max2101.000-2096.000=5.000
mean4.530-4.444=0.087
σ0.126-0.055=0.071
min4.414-4.399=0.015
max4.724-4.538=0.186

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.188-1.339=-0.151
σ0.343-0.336=0.006
min0.906-0.914=-0.008
max1.743-1.810=-0.067

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.782-436.784=-0.002
σ572.367-572.356=0.012
min150.596-150.601=-0.004
max1295.333-1295.318=0.015
mean90.250
σ8.500
min86.000
max103.000
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.531-0.520=0.012
σ0.559-0.543=0.016
min0.247-0.248=-0.001
max1.369-1.334=0.035
policies=20
mean1506.285-1506.260=0.025
σ0.276-0.229=0.046
min1506.109-1506.098=0.010
max1506.696-1506.599=0.097
mean860.000
σ0.000
min860.000
max860.000
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean2.569-2.502=0.067
σ0.063-0.022=0.041
min2.508-2.487=0.021
max2.647-2.534=0.113
policies=200
mean15070.385-15070.397=-0.012
σ0.055-0.062=-0.008
min15070.315-15070.328=-0.013
max15070.431-15070.457=-0.026
mean8600.000
σ0.000
min8600.000
max8600.000
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean25.396-25.454=-0.057
σ0.143-0.143=-0.000
min25.233-25.330=-0.097
max25.517-25.614=-0.096