Compare commits

Home / Compare bf4cd22b .. d417a627

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.685-70.687=-0.001
σ0.044-0.045=-0.001
min70.659-70.663=-0.005
max70.810-70.815=-0.005
mean415.900-414.000=1.900
σ0.316-0.000=0.316
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.158-0.160=-0.002
σ0.004-0.003=0.001
min0.150-0.156=-0.006
max0.163-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.421-21.421=-0.000
σ0.002-0.002=0.000
min21.417-21.418=-0.001
max21.424-21.424=-0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.001
min0.059-0.063=-0.004
max0.067-0.074=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.457=0.001
σ0.359-0.359=-0.000
min1753.891-1753.896=-0.004
max1755.016-1755.036=-0.020
mean1670.950-1647.200=23.750
σ652.623-628.376=24.247
min641.000-627.000=14.000
max2870.000-2864.000=6.000
mean2.806-2.819=-0.013
σ0.202-0.275=-0.073
min2.288-2.154=0.134
max3.137-3.511=-0.374

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.502-273.507=-0.005
σ0.004-0.004=-0.000
min273.498-273.500=-0.003
max273.507-273.511=-0.003
mean2870.000-2864.000=6.000
σ0.000
min2870.000-2864.000=6.000
max2870.000-2864.000=6.000
mean0.378-0.386=-0.007
σ0.006-0.012=-0.007
min0.375-0.378=-0.003
max0.388-0.407=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1933.899-1933.899=0.000
σ0.019-0.007=0.012
min1933.873-1933.886=-0.013
max1933.927-1933.906=0.021
mean2870.000-2864.000=6.000
σ0.000
min2870.000-2864.000=6.000
max2870.000-2864.000=6.000
mean2.973-3.009=-0.036
σ0.300-0.012=0.288
min2.463-3.003=-0.540
max3.245-3.030=0.215
iters=5
new-facts=6402
prior-facts=1
mean4754.696-4754.735=-0.039
σ0.890-0.805=0.085
min4754.162-4754.295=-0.132
max4756.274-4756.172=0.102
mean2870.000-2864.000=6.000
σ0.000
min2870.000-2864.000=6.000
max2870.000-2864.000=6.000
mean8.372-7.973=0.399
σ0.523-0.342=0.182
min7.843-7.724=0.118
max9.080-8.570=0.511
iters=5
new-facts=6402
prior-facts=6402
mean4945.117-4945.114=0.002
σ0.017-0.012=0.006
min4945.095-4945.100=-0.005
max4945.142-4945.132=0.010
mean3064.000-3052.000=12.000
σ249.848-264.484=-14.636
min2870.000-2864.000=6.000
max3436.000-3472.000=-36.000
mean8.491-8.451=0.040
σ0.110-0.113=-0.003
min8.410-8.355=0.055
max8.679-8.641=0.038

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.064=-0.042
σ0.142-0.146=-0.004
min0.920-0.934=-0.014
max1.256-1.288=-0.032

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.567-472.568=-0.001
σ574.931-574.927=0.003
min185.097-185.099=-0.002
max1334.963-1334.959=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2870.000-2864.000=6.000
σ0.000
min2870.000-2864.000=6.000
max2870.000-2864.000=6.000
mean0.452-0.448=0.005
σ0.308-0.306=0.002
min0.296-0.289=0.007
max0.914-0.907=0.008
policies=20
mean1851.297-1851.264=0.033
σ0.365-0.381=-0.016
min1851.036-1850.986=0.051
max1851.829-1851.820=0.009
mean840.000
σ0.000
min840.000
max840.000
mean2870.000-2864.000=6.000
σ0.000
min2870.000-2864.000=6.000
max2870.000-2864.000=6.000
mean2.966-2.948=0.017
σ0.013-0.001=0.012
min2.949-2.947=0.003
max2.979-2.950=0.028
policies=200
mean18519.469-18519.284=0.185
σ0.434-0.496=-0.061
min18519.134-18518.906=0.228
max18520.087-18520.013=0.074
mean8400.000
σ0.000
min8400.000
max8400.000
mean2870.000-2864.000=6.000
σ0.000
min2870.000-2864.000=6.000
max2870.000-2864.000=6.000
mean29.255-29.185=0.071
σ0.456-0.442=0.015
min28.938-28.828=0.110
max29.931-29.787=0.144