Compare commits

Home / Compare f0715e64 .. d7fba7cf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.695=0.001
σ0.045-0.046=-0.001
min70.669-70.668=0.002
max70.821-70.823=-0.002
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.158-0.157=0.002
σ0.005-0.005=0.000
min0.151-0.149=0.002
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.421-21.421=0.000
σ0.002-0.002=-0.001
min21.418-21.417=0.001
max21.425-21.424=0.000
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.063-0.065=-0.003
σ0.004-0.003=0.001
min0.059-0.064=-0.004
max0.073-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.458=-0.000
σ0.362-0.360=0.002
min1753.893-1753.885=0.008
max1755.044-1755.033=0.011
mean1659.200-1669.200=-10.000
σ629.565-649.687=-20.123
min628.000-623.000=5.000
max2676.000-2868.000=-192.000
mean2.798-2.799=-0.002
σ0.183-0.175=0.008
min2.382-2.285=0.097
max3.073-2.998=0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.501-273.502=-0.001
σ0.007-0.007=0.000
min273.490-273.494=-0.003
max273.511-273.513=-0.001
mean2676.000-2868.000=-192.000
σ0.000
min2676.000-2868.000=-192.000
max2676.000-2868.000=-192.000
mean0.378-0.384=-0.007
σ0.004-0.006=-0.002
min0.375-0.381=-0.006
max0.384-0.395=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1933.897-1933.915=-0.018
σ0.015-0.015=0.001
min1933.877-1933.903=-0.026
max1933.917-1933.939=-0.022
mean2676.000-2868.000=-192.000
σ0.000
min2676.000-2868.000=-192.000
max2676.000-2868.000=-192.000
mean2.911-2.813=0.098
σ0.131-0.238=-0.107
min2.701-2.454=0.246
max3.036-3.028=0.008
iters=5
new-facts=6402
prior-facts=1
mean4754.390-4754.641=-0.250
σ1.040-0.922=0.118
min4753.570-4754.160=-0.590
max4756.151-4756.287=-0.136
mean2676.000-2868.000=-192.000
σ0.000
min2676.000-2868.000=-192.000
max2676.000-2868.000=-192.000
mean8.755-8.779=-0.024
σ0.306-0.282=0.024
min8.385-8.494=-0.110
max9.133-9.123=0.010
iters=5
new-facts=6402
prior-facts=6402
mean4945.112-4944.979=0.133
σ0.024-0.322=-0.298
min4945.080-4944.404=0.676
max4945.139-4945.143=-0.004
mean3000.400-3055.800=-55.400
σ249.211-208.577=40.635
min2676.000-2868.000=-192.000
max3301.000-3375.000=-74.000
mean8.578-8.665=-0.087
σ0.133-0.226=-0.093
min8.426-8.427=-0.002
max8.791-8.945=-0.154

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.074-1.049=0.024
σ0.151-0.143=0.007
min0.917-0.924=-0.007
max1.249-1.274=-0.025

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.065-473.079=-0.014
σ575.919-575.908=0.010
min185.096-185.118=-0.021
max1336.943-1336.941=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2676.000-2868.000=-192.000
σ0.000
min2676.000-2868.000=-192.000
max2676.000-2868.000=-192.000
mean0.579-0.496=0.083
σ0.572-0.377=0.196
min0.291-0.306=-0.015
max1.438-1.061=0.377
policies=20
mean1851.263-1851.428=-0.165
σ0.377-0.372=0.005
min1851.019-1851.147=-0.128
max1851.821-1851.968=-0.147
mean840.000
σ0.000
min840.000
max840.000
mean2676.000-2868.000=-192.000
σ0.000
min2676.000-2868.000=-192.000
max2676.000-2868.000=-192.000
mean2.859-2.957=-0.099
σ0.007-0.014=-0.007
min2.851-2.945=-0.094
max2.867-2.978=-0.110
policies=200
mean18519.359-18519.759=-0.400
σ0.546-0.642=-0.096
min18518.998-18519.257=-0.259
max18520.169-18520.611=-0.443
mean8400.000
σ0.000
min8400.000
max8400.000
mean2676.000-2868.000=-192.000
σ0.000
min2676.000-2868.000=-192.000
max2676.000-2868.000=-192.000
mean28.822-29.172=-0.350
σ0.095-0.452=-0.357
min28.726-28.779=-0.054
max28.950-29.823=-0.873