Compare commits

Home / Compare 3ac269e4 .. fcc642fa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.063-73.065=-0.002
σ0.046-0.048=-0.002
min73.036-73.043=-0.007
max73.192-73.200=-0.008
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.157-0.161=-0.004
σ0.006-0.004=0.002
min0.151-0.157=-0.007
max0.168-0.169=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.756-23.756=0.000
σ0.004-0.004=0.000
min23.750-23.751=-0.001
max23.763-23.762=0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.068-0.068=-0.000
σ0.003-0.004=-0.001
min0.066-0.066=0.000
max0.076-0.077=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.792-1758.793=-0.001
σ0.362-0.361=0.000
min1758.224-1758.220=0.004
max1759.377-1759.373=0.005
mean1645.700-1628.450=17.250
σ629.207-600.982=28.225
min621.000-625.000=-4.000
max2771.000-2425.000=346.000
mean2.780-2.823=-0.043
σ0.230-0.137=0.093
min2.171-2.392=-0.221
max3.048-3.032=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean323.999-324.022=-0.023
σ0.049-0.054=-0.006
min323.914-323.925=-0.011
max324.040-324.050=-0.010
mean2771.000-2425.000=346.000
σ0.000
min2771.000-2425.000=346.000
max2771.000-2425.000=346.000
mean0.430-0.428=0.002
σ0.003-0.005=-0.002
min0.427-0.425=0.003
max0.435-0.436=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1984.593-1984.588=0.005
σ0.021-0.023=-0.003
min1984.565-1984.562=0.003
max1984.611-1984.608=0.003
mean2771.000-2425.000=346.000
σ0.000
min2771.000-2425.000=346.000
max2771.000-2425.000=346.000
mean2.576-2.687=-0.111
σ0.017-0.155=-0.138
min2.554-2.561=-0.007
max2.598-2.860=-0.262
iters=5
new-facts=6402
prior-facts=1
mean4808.228-4808.111=0.117
σ7.813-7.842=-0.029
min4804.662-4804.089=0.574
max4822.204-4822.129=0.075
mean2771.000-2425.000=346.000
σ0.000
min2771.000-2425.000=346.000
max2771.000-2425.000=346.000
mean9.017-8.635=0.381
σ0.155-0.370=-0.214
min8.869-8.103=0.766
max9.210-9.032=0.177
iters=5
new-facts=6402
prior-facts=6402
mean4995.817-4995.735=0.082
σ0.021-0.167=-0.146
min4995.785-4995.437=0.348
max4995.838-4995.828=0.010
mean3047.000-2898.000=149.000
σ338.314-399.332=-61.018
min2771.000-2425.000=346.000
max3558.000-3456.000=102.000
mean8.539-8.441=0.099
σ0.116-0.044=0.072
min8.441-8.383=0.058
max8.682-8.483=0.199

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.671=-0.651
σ0.142-0.074=0.067
min0.923-1.611=-0.688
max1.252-1.798=-0.545

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.368-468.330=0.037
σ574.238-574.232=0.005
min181.238-181.212=0.026
max1329.724-1329.679=0.045
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2425.000=346.000
σ0.000
min2771.000-2425.000=346.000
max2771.000-2425.000=346.000
mean0.434-0.552=-0.118
σ0.310-0.538=-0.228
min0.258-0.281=-0.022
max0.898-1.359=-0.460
policies=20
mean1812.727-1812.484=0.243
σ0.385-0.389=-0.004
min1812.458-1812.223=0.236
max1813.293-1813.059=0.234
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2425.000=346.000
σ0.000
min2771.000-2425.000=346.000
max2771.000-2425.000=346.000
mean2.895-2.819=0.076
σ0.013-0.019=-0.006
min2.883-2.799=0.084
max2.910-2.841=0.069
policies=200
mean18132.485-18132.360=0.124
σ0.576-0.504=0.072
min18132.118-18131.940=0.179
max18133.342-18133.093=0.249
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2425.000=346.000
σ0.000
min2771.000-2425.000=346.000
max2771.000-2425.000=346.000
mean28.424-28.248=0.175
σ0.162-0.052=0.110
min28.229-28.189=0.040
max28.559-28.302=0.257