Compare commits

Home / Compare 5e909688 .. e736128c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.917=-0.002
σ0.367-0.367=-0.000
min53.785-53.789=-0.004
max54.959-54.961=-0.002
mean414.000-418.100=-4.100
σ0.000-0.316=-0.316
min414.000-418.000=-4.000
max414.000-419.000=-5.000
mean0.139-0.142=-0.003
σ0.005-0.004=0.001
min0.132-0.137=-0.005
max0.148-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.144-43.142=0.003
σ0.012-0.005=0.007
min43.134-43.135=-0.001
max43.174-43.152=0.022
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.124-0.123=0.001
σ0.003-0.003=0.000
min0.121-0.120=0.000
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.807-991.802=0.005
σ1.233-1.236=-0.003
min991.230-991.235=-0.005
max996.995-997.008=-0.012
mean1070.300-1076.850=-6.550
σ313.817-318.656=-4.839
min615.000-619.000=-4.000
max1649.000-1640.000=9.000
mean1.527-1.508=0.019
σ0.074-0.043=0.031
min1.421-1.439=-0.019
max1.731-1.607=0.124

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.382-285.412=-0.030
σ0.010-0.015=-0.005
min285.365-285.388=-0.022
max285.391-285.426=-0.035
mean1649.000-1640.000=9.000
σ0.000
min1649.000-1640.000=9.000
max1649.000-1640.000=9.000
mean0.378-0.379=-0.000
σ0.005-0.007=-0.002
min0.375-0.373=0.002
max0.388-0.387=0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.374-1285.372=0.002
σ0.140-0.123=0.017
min1285.303-1285.309=-0.007
max1285.623-1285.591=0.032
mean1649.000-1640.000=9.000
σ0.000
min1649.000-1640.000=9.000
max1649.000-1640.000=9.000
mean1.834-1.939=-0.105
σ0.030-0.136=-0.107
min1.791-1.810=-0.019
max1.858-2.095=-0.238
iters=5
new-facts=6402
prior-facts=1
mean1807.680-1807.695=-0.014
σ7.016-7.002=0.014
min1804.277-1804.349=-0.072
max1820.214-1820.206=0.007
mean1649.000-1640.000=9.000
σ0.000
min1649.000-1640.000=9.000
max1649.000-1640.000=9.000
mean4.103-4.147=-0.044
σ0.284-0.233=0.051
min3.773-3.855=-0.083
max4.533-4.432=0.101
iters=5
new-facts=6402
prior-facts=6402
mean2070.194-2070.198=-0.004
σ0.009-0.014=-0.005
min2070.183-2070.185=-0.002
max2070.208-2070.220=-0.012
mean1849.600-1860.800=-11.200
σ207.675-195.949=11.725
min1649.000-1640.000=9.000
max2087.000-2085.000=2.000
mean4.465-4.626=-0.161
σ0.075-0.250=-0.175
min4.391-4.433=-0.042
max4.585-5.039=-0.454

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.196=-0.015
σ0.263-0.379=-0.117
min0.924-0.912=0.012
max1.608-1.834=-0.226

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.783-436.784=-0.001
σ572.358-572.367=-0.009
min150.597-150.598=-0.001
max1295.320-1295.334=-0.014
mean90.250
σ8.500
min86.000
max103.000
mean1649.000-1640.000=9.000
σ0.000
min1649.000-1640.000=9.000
max1649.000-1640.000=9.000
mean0.530-0.518=0.012
σ0.556-0.537=0.019
min0.250-0.248=0.002
max1.364-1.323=0.040
policies=20
mean1506.295-1506.276=0.019
σ0.280-0.242=0.039
min1506.123-1506.123=0.000
max1506.714-1506.637=0.077
mean860.000
σ0.000
min860.000
max860.000
mean1649.000-1640.000=9.000
σ0.000
min1649.000-1640.000=9.000
max1649.000-1640.000=9.000
mean2.585-2.519=0.065
σ0.066-0.013=0.054
min2.507-2.507=-0.001
max2.666-2.537=0.129
policies=200
mean15070.249-15070.409=-0.161
σ0.096-0.102=-0.006
min15070.156-15070.260=-0.103
max15070.354-15070.477=-0.123
mean8600.000
σ0.000
min8600.000
max8600.000
mean1649.000-1640.000=9.000
σ0.000
min1649.000-1640.000=9.000
max1649.000-1640.000=9.000
mean25.655-25.523=0.132
σ0.153-0.124=0.028
min25.517-25.400=0.116
max25.869-25.636=0.233