Compare commits

Home / Compare 9d0db23d .. 80b15948

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.608-70.609=-0.001
σ0.044-0.046=-0.001
min70.583-70.584=-0.000
max70.732-70.736=-0.004
mean413.800-418.400=-4.600
σ0.422-0.516=-0.095
min413.000-418.000=-5.000
max414.000-419.000=-5.000
mean0.160-0.159=0.001
σ0.003-0.003=0.000
min0.157-0.157=-0.000
max0.165-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.331-21.336=-0.004
σ0.002-0.009=-0.007
min21.328-21.330=-0.002
max21.334-21.361=-0.027
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.064-0.065=-0.001
σ0.004-0.003=0.001
min0.060-0.063=-0.003
max0.073-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.374=0.002
σ0.361-0.361=-0.000
min1752.798-1752.804=-0.006
max1753.974-1753.959=0.015
mean1662.000-1666.100=-4.100
σ638.602-636.169=2.433
min618.000-693.000=-75.000
max2814.000-2772.000=42.000
mean2.848-2.780=0.068
σ0.115-0.187=-0.071
min2.514-2.391=0.123
max3.088-3.179=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.755-271.758=-0.002
σ0.006-0.003=0.002
min271.749-271.754=-0.005
max271.761-271.762=-0.002
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean0.380-0.382=-0.001
σ0.004-0.006=-0.002
min0.378-0.377=0.001
max0.388-0.391=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.172-1932.172=-0.000
σ0.016-0.009=0.007
min1932.148-1932.159=-0.011
max1932.186-1932.181=0.005
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean3.011-3.024=-0.014
σ0.049-0.046=0.003
min2.964-2.989=-0.025
max3.081-3.087=-0.006
iters=5
new-facts=6402
prior-facts=1
mean4752.880-4752.940=-0.060
σ0.924-0.858=0.067
min4752.401-4752.494=-0.092
max4754.532-4754.469=0.063
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean8.771-8.408=0.364
σ0.220-0.477=-0.257
min8.523-7.566=0.957
max9.040-8.717=0.323
iters=5
new-facts=6402
prior-facts=6402
mean4943.304-4943.309=-0.006
σ0.165-0.151=0.014
min4943.009-4943.040=-0.032
max4943.384-4943.397=-0.012
mean3003.200-2999.600=3.600
σ203.801-213.098=-9.297
min2814.000-2772.000=42.000
max3306.000-3311.000=-5.000
mean8.510-8.441=0.069
σ0.088-0.066=0.022
min8.445-8.367=0.078
max8.656-8.519=0.138

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.084-1.081=0.003
σ0.112-0.138=-0.026
min0.939-0.991=-0.051
max1.254-1.306=-0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.862-467.857=0.005
σ575.928-575.930=-0.002
min179.887-179.889=-0.002
max1331.754-1331.752=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean0.482-0.448=0.033
σ0.401-0.320=0.081
min0.278-0.287=-0.009
max1.083-0.928=0.155
policies=20
mean1799.140-1799.171=-0.031
σ0.372-0.326=0.046
min1798.881-1798.942=-0.061
max1799.692-1799.653=0.039
mean820.000
σ0.000
min820.000
max820.000
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean2.809-2.836=-0.027
σ0.020-0.094=-0.074
min2.792-2.782=0.010
max2.832-2.976=-0.144
policies=200
mean17998.445-17998.499=-0.054
σ0.534-0.506=0.027
min17998.042-17998.200=-0.158
max17999.231-17999.257=-0.026
mean8200.000
σ0.000
min8200.000
max8200.000
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean28.267-27.935=0.333
σ0.113-0.023=0.090
min28.168-27.903=0.264
max28.421-27.958=0.463