Compare commits

Home / Compare 6d0afacb .. f0d92be3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.048-73.044=0.004
σ0.048-0.048=-0.000
min73.023-73.012=0.011
max73.183-73.177=0.006
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.162-0.159=0.003
σ0.003-0.004=-0.001
min0.157-0.156=0.001
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean23.740-23.738=0.002
σ0.002-0.002=-0.000
min23.737-23.733=0.004
max23.745-23.741=0.004
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.066-0.064=0.002
σ0.002-0.003=-0.001
min0.064-0.061=0.004
max0.073-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.787=0.001
σ0.363-0.363=-0.000
min1758.212-1758.208=0.004
max1759.383-1759.373=0.011
mean1644.650-1654.400=-9.750
σ626.223-631.735=-5.512
min621.000-616.000=5.000
max2776.000-2888.000=-112.000
mean2.771-2.775=-0.004
σ0.151-0.199=-0.048
min2.340-2.305=0.035
max3.027-3.093=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.011-324.007=0.005
σ0.052-0.052=0.001
min323.918-323.918=0.000
max324.039-324.046=-0.007
mean2776.000-2888.000=-112.000
σ0.000
min2776.000-2888.000=-112.000
max2776.000-2888.000=-112.000
mean0.437-0.432=0.005
σ0.010-0.005=0.006
min0.425-0.428=-0.002
max0.450-0.438=0.012
iters=5
new-facts=1
prior-facts=6402
mean1984.592-1984.586=0.006
σ0.014-0.025=-0.011
min1984.577-1984.560=0.017
max1984.608-1984.613=-0.005
mean2776.000-2888.000=-112.000
σ0.000
min2776.000-2888.000=-112.000
max2776.000-2888.000=-112.000
mean2.612-2.670=-0.057
σ0.164-0.246=-0.082
min2.465-2.519=-0.054
max2.840-3.106=-0.265
iters=5
new-facts=6402
prior-facts=1
mean4808.141-4808.232=-0.091
σ7.894-7.824=0.070
min4804.176-4804.638=-0.463
max4822.254-4822.227=0.027
mean2776.000-2888.000=-112.000
σ0.000
min2776.000-2888.000=-112.000
max2776.000-2888.000=-112.000
mean9.138-8.848=0.290
σ0.213-0.149=0.064
min8.902-8.635=0.266
max9.465-9.021=0.443
iters=5
new-facts=6402
prior-facts=6402
mean4995.808-4995.740=0.068
σ0.022-0.155=-0.133
min4995.783-4995.465=0.318
max4995.836-4995.837=-0.001
mean3036.200-3035.600=0.600
σ207.865-174.861=33.004
min2776.000-2888.000=-112.000
max3321.000-3316.000=5.000
mean8.686-8.644=0.042
σ0.263-0.146=0.116
min8.455-8.498=-0.043
max9.088-8.856=0.231

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.104-1.011=0.093
σ0.136-0.138=-0.003
min0.930-0.917=0.014
max1.242-1.234=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.353-468.355=-0.002
σ574.249-574.229=0.020
min181.226-181.230=-0.004
max1329.726-1329.698=0.028
mean88.250
σ8.500
min84.000
max101.000
mean2776.000-2888.000=-112.000
σ0.000
min2776.000-2888.000=-112.000
max2776.000-2888.000=-112.000
mean0.482-0.444=0.038
σ0.375-0.301=0.074
min0.291-0.291=-0.000
max1.045-0.895=0.149
policies=20
mean1812.612-1812.637=-0.025
σ0.390-0.396=-0.006
min1812.338-1812.364=-0.025
max1813.184-1813.219=-0.035
mean840.000
σ0.000
min840.000
max840.000
mean2776.000-2888.000=-112.000
σ0.000
min2776.000-2888.000=-112.000
max2776.000-2888.000=-112.000
mean2.908-2.892=0.016
σ0.036-0.011=0.025
min2.879-2.879=0.000
max2.960-2.903=0.058
policies=200
mean18131.517-18132.327=-0.810
σ0.421-0.912=-0.491
min18131.169-18131.128=0.041
max18132.082-18133.063=-0.981
mean8400.000
σ0.000
min8400.000
max8400.000
mean2776.000-2888.000=-112.000
σ0.000
min2776.000-2888.000=-112.000
max2776.000-2888.000=-112.000
mean28.419-28.709=-0.290
σ0.198-0.361=-0.163
min28.247-28.349=-0.102
max28.637-29.105=-0.468