Compare commits

Home / Compare f2d63246 .. daeae891

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.917-53.914=0.003
σ0.368-0.366=0.002
min53.790-53.778=0.013
max54.965-54.955=0.009
mean416.000-414.300=1.700
σ0.000-0.483=-0.483
min416.000-414.000=2.000
max416.000-415.000=1.000
mean0.147-0.139=0.008
σ0.010-0.004=0.006
min0.137-0.135=0.002
max0.161-0.146=0.015
cache=y
dps=1
iters=10
policies=100
mean43.141-43.139=0.001
σ0.006-0.006=-0.000
min43.129-43.129=0.000
max43.148-43.149=-0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.119=0.002
σ0.004-0.004=-0.000
min0.115-0.114=0.001
max0.125-0.124=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.818-991.816=0.001
σ1.253-1.248=0.005
min991.227-991.229=-0.003
max997.084-997.060=0.024
mean1066.050-1069.550=-3.500
σ322.196-318.762=3.435
min569.000-615.000=-46.000
max1637.000-1632.000=5.000
mean1.547-1.531=0.017
σ0.120-0.081=0.039
min1.398-1.464=-0.065
max1.895-1.818=0.077

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.407=0.005
σ0.010-0.011=-0.002
min285.400-285.392=0.008
max285.424-285.421=0.003
mean1637.000-1632.000=5.000
σ0.000
min1637.000-1632.000=5.000
max1637.000-1632.000=5.000
mean0.383-0.375=0.009
σ0.009-0.002=0.007
min0.374-0.373=0.002
max0.395-0.376=0.019
iters=5
new-facts=1
prior-facts=6402
mean1285.378-1285.372=0.006
σ0.135-0.132=0.003
min1285.314-1285.307=0.007
max1285.620-1285.609=0.011
mean1637.000-1632.000=5.000
σ0.000
min1637.000-1632.000=5.000
max1637.000-1632.000=5.000
mean1.871-1.890=-0.019
σ0.069-0.070=-0.001
min1.815-1.819=-0.005
max1.987-2.008=-0.021
iters=5
new-facts=6402
prior-facts=1
mean1807.741-1807.725=0.017
σ7.004-6.988=0.016
min1804.363-1804.314=0.048
max1820.253-1820.206=0.047
mean1637.000-1632.000=5.000
σ0.000
min1637.000-1632.000=5.000
max1637.000-1632.000=5.000
mean4.297-4.221=0.077
σ0.204-0.272=-0.067
min4.099-3.861=0.238
max4.572-4.568=0.004
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.195=-0.000
σ0.013-0.010=0.003
min2070.180-2070.185=-0.005
max2070.213-2070.207=0.006
mean1853.000-1841.600=11.400
σ207.548-191.980=15.568
min1637.000-1632.000=5.000
max2087.000-2086.000=1.000
mean4.485-4.478=0.008
σ0.044-0.084=-0.040
min4.427-4.431=-0.005
max4.538-4.627=-0.089

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.199-1.245=-0.047
σ0.242-0.366=-0.124
min0.927-0.915=0.012
max1.566-1.835=-0.269

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.792-436.785=0.006
σ572.363-572.359=0.004
min150.599-150.600=-0.001
max1295.336-1295.324=0.012
mean90.250
σ8.500
min86.000
max103.000
mean1637.000-1632.000=5.000
σ0.000
min1637.000-1632.000=5.000
max1637.000-1632.000=5.000
mean0.532-0.535=-0.003
σ0.560-0.555=0.005
min0.249-0.252=-0.004
max1.372-1.367=0.004
policies=20
mean1506.270-1506.265=0.005
σ0.240-0.254=-0.014
min1506.117-1506.097=0.020
max1506.628-1506.643=-0.015
mean860.000
σ0.000
min860.000
max860.000
mean1637.000-1632.000=5.000
σ0.000
min1637.000-1632.000=5.000
max1637.000-1632.000=5.000
mean2.517-2.527=-0.011
σ0.014-0.010=0.004
min2.501-2.518=-0.017
max2.535-2.538=-0.003
policies=200
mean15070.387-15070.406=-0.019
σ0.028-0.056=-0.028
min15070.353-15070.343=0.011
max15070.421-15070.474=-0.053
mean8600.000
σ0.000
min8600.000
max8600.000
mean1637.000-1632.000=5.000
σ0.000
min1637.000-1632.000=5.000
max1637.000-1632.000=5.000
mean25.491-25.432=0.059
σ0.138-0.146=-0.009
min25.332-25.301=0.032
max25.629-25.626=0.003