Compare commits

Home / Compare cc2ba89c .. d3a5e489

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.378-70.379=-0.001
σ0.045-0.043=0.002
min70.352-70.356=-0.004
max70.504-70.499=0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.157-0.158=-0.002
σ0.004-0.005=-0.001
min0.152-0.151=0.001
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.003=-0.000
min21.140-21.140=-0.000
max21.148-21.150=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.001
min0.063-0.063=0.000
max0.072-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.386=0.001
σ0.363-0.361=0.002
min1751.819-1751.821=-0.002
max1752.974-1752.953=0.021
mean1630.500-1629.300=1.200
σ597.995-593.717=4.277
min641.000-624.000=17.000
max2410.000-2423.000=-13.000
mean2.751-2.805=-0.054
σ0.252-0.166=0.086
min2.173-2.441=-0.267
max3.266-3.039=0.227

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.128-270.132=-0.003
σ0.006-0.003=0.003
min270.119-270.127=-0.008
max270.136-270.135=0.001
mean2410.000-2423.000=-13.000
σ0.000
min2410.000-2423.000=-13.000
max2410.000-2423.000=-13.000
mean0.381-0.380=0.001
σ0.003-0.007=-0.004
min0.379-0.372=0.007
max0.387-0.391=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.594-1930.592=0.002
σ0.012-0.016=-0.004
min1930.578-1930.564=0.014
max1930.609-1930.602=0.007
mean2410.000-2423.000=-13.000
σ0.000
min2410.000-2423.000=-13.000
max2410.000-2423.000=-13.000
mean2.628-2.545=0.084
σ0.176-0.097=0.078
min2.446-2.447=-0.001
max2.860-2.682=0.178
iters=5
new-facts=6402
prior-facts=1
mean4751.072-4751.087=-0.014
σ0.880-0.855=0.024
min4750.492-4750.654=-0.161
max4752.633-4752.615=0.018
mean2410.000-2423.000=-13.000
σ0.000
min2410.000-2423.000=-13.000
max2410.000-2423.000=-13.000
mean8.483-8.407=0.076
σ0.582-0.601=-0.019
min7.613-7.712=-0.099
max9.027-9.048=-0.021
iters=5
new-facts=6402
prior-facts=6402
mean4941.532-4941.453=0.079
σ0.087-0.202=-0.115
min4941.449-4941.118=0.331
max4941.637-4941.616=0.021
mean3019.600-2958.600=61.000
σ374.361-453.411=-79.050
min2512.000-2423.000=89.000
max3377.000-3566.000=-189.000
mean8.661-8.386=0.275
σ0.475-0.141=0.335
min8.196-8.273=-0.077
max9.458-8.609=0.850

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.771-1.857=-0.086
σ0.087-0.135=-0.047
min1.698-1.629=0.069
max1.914-1.984=-0.070

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.362-466.362=0.000
σ575.931-575.934=-0.003
min178.392-178.392=-0.000
max1330.259-1330.263=-0.004
mean84.000
σ8.000
min80.000
max96.000
mean2410.000-2423.000=-13.000
σ0.000
min2410.000-2423.000=-13.000
max2410.000-2423.000=-13.000
mean0.563-0.559=0.003
σ0.567-0.564=0.003
min0.277-0.277=-0.000
max1.413-1.406=0.007
policies=20
mean1784.223-1784.215=0.008
σ0.362-0.342=0.019
min1783.988-1783.995=-0.008
max1784.761-1784.724=0.036
mean800.000
σ0.000
min800.000
max800.000
mean2410.000-2423.000=-13.000
σ0.000
min2410.000-2423.000=-13.000
max2410.000-2423.000=-13.000
mean2.776-2.772=0.004
σ0.007-0.007=-0.000
min2.767-2.763=0.004
max2.784-2.781=0.003
policies=200
mean17848.772-17848.780=-0.008
σ0.455-0.571=-0.117
min17848.450-17848.396=0.054
max17849.437-17849.615=-0.178
mean8000.000
σ0.000
min8000.000
max8000.000
mean2410.000-2423.000=-13.000
σ0.000
min2410.000-2423.000=-13.000
max2410.000-2423.000=-13.000
mean27.962-27.940=0.022
σ0.067-0.088=-0.021
min27.892-27.809=0.083
max28.051-27.997=0.054