Compare commits

Home / Compare 086a8aa9 .. 39e0cc3a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.044-73.046=-0.002
σ0.050-0.050=0.000
min73.021-73.021=-0.001
max73.184-73.186=-0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.158-0.161=-0.003
σ0.008-0.004=0.003
min0.150-0.157=-0.007
max0.173-0.167=0.005
cache=y
dps=1
iters=10
policies=100
mean23.741-23.740=0.001
σ0.003-0.004=-0.001
min23.737-23.735=0.001
max23.747-23.748=-0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.066-0.067=-0.001
σ0.002-0.003=-0.001
min0.064-0.064=0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.789-1758.788=0.001
σ0.362-0.363=-0.001
min1758.216-1758.210=0.006
max1759.372-1759.368=0.004
mean1646.850-1656.200=-9.350
σ626.742-620.053=6.689
min621.000-627.000=-6.000
max2778.000-2505.000=273.000
mean2.861-2.782=0.080
σ0.106-0.211=-0.105
min2.618-2.290=0.329
max3.071-2.980=0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.016-324.018=-0.002
σ0.043-0.051=-0.009
min323.940-323.928=0.012
max324.043-324.057=-0.014
mean2778.000-2505.000=273.000
σ0.000
min2778.000-2505.000=273.000
max2778.000-2505.000=273.000
mean0.425-0.432=-0.007
σ0.004-0.007=-0.003
min0.422-0.425=-0.003
max0.433-0.441=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1984.580-1984.589=-0.009
σ0.025-0.018=0.007
min1984.550-1984.557=-0.008
max1984.606-1984.601=0.006
mean2778.000-2505.000=273.000
σ0.000
min2778.000-2505.000=273.000
max2778.000-2505.000=273.000
mean2.626-2.669=-0.043
σ0.150-0.124=0.025
min2.474-2.578=-0.104
max2.860-2.875=-0.015
iters=5
new-facts=6402
prior-facts=1
mean4808.180-4808.267=-0.087
σ7.762-7.850=-0.087
min4804.425-4804.708=-0.283
max4822.062-4822.309=-0.247
mean2778.000-2505.000=273.000
σ0.000
min2778.000-2505.000=273.000
max2778.000-2505.000=273.000
mean8.213-9.084=-0.871
σ0.580-0.243=0.337
min7.726-8.800=-1.074
max9.137-9.365=-0.228
iters=5
new-facts=6402
prior-facts=6402
mean4995.801-4995.798=0.003
σ0.020-0.019=0.001
min4995.781-4995.778=0.004
max4995.824-4995.816=0.009
mean3050.000-2905.800=144.200
σ329.643-359.343=-29.700
min2778.000-2505.000=273.000
max3543.000-3414.000=129.000
mean8.487-8.465=0.022
σ0.174-0.042=0.132
min8.331-8.424=-0.093
max8.784-8.522=0.262

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.977-1.699=-0.722
σ0.133-0.170=-0.037
min0.911-1.401=-0.490
max1.214-1.810=-0.596

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.355-468.322=0.033
σ574.229-574.231=-0.002
min181.228-181.202=0.026
max1329.698-1329.669=0.030
mean88.250
σ8.500
min84.000
max101.000
mean2778.000-2505.000=273.000
σ0.000
min2778.000-2505.000=273.000
max2778.000-2505.000=273.000
mean0.429-0.569=-0.140
σ0.273-0.574=-0.300
min0.290-0.279=0.010
max0.839-1.429=-0.591
policies=20
mean1812.645-1812.407=0.238
σ0.409-0.397=0.012
min1812.370-1812.145=0.225
max1813.250-1812.996=0.254
mean840.000
σ0.000
min840.000
max840.000
mean2778.000-2505.000=273.000
σ0.000
min2778.000-2505.000=273.000
max2778.000-2505.000=273.000
mean2.882-2.815=0.067
σ0.010-0.014=-0.004
min2.869-2.797=0.072
max2.891-2.829=0.061
policies=200
mean18131.738-18131.571=0.167
σ0.466-0.538=-0.072
min18131.458-18131.153=0.304
max18132.434-18132.339=0.095
mean8400.000
σ0.000
min8400.000
max8400.000
mean2778.000-2505.000=273.000
σ0.000
min2778.000-2505.000=273.000
max2778.000-2505.000=273.000
mean28.384-28.436=-0.052
σ0.118-0.075=0.042
min28.256-28.351=-0.094
max28.531-28.533=-0.003