Compare commits

Home / Compare 2c3e92db .. be8e8fd1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=-0.000
σ0.367-0.369=-0.002
min53.779-53.788=-0.008
max54.957-54.963=-0.006
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.139-0.137=0.002
σ0.004-0.005=-0.001
min0.135-0.130=0.005
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.140=0.000
σ0.007-0.006=0.001
min43.131-43.132=-0.002
max43.155-43.150=0.005
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.120-0.121=-0.000
σ0.003-0.004=-0.001
min0.117-0.112=0.005
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.809-991.818=-0.009
σ1.232-1.237=-0.005
min991.232-991.232=0.000
max996.989-997.011=-0.022
mean1069.200-1072.850=-3.650
σ312.445-314.819=-2.373
min616.000-625.000=-9.000
max1642.000-1634.000=8.000
mean1.514-1.533=-0.019
σ0.087-0.103=-0.016
min1.397-1.380=0.017
max1.757-1.885=-0.128

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.412=-0.001
σ0.011-0.015=-0.004
min285.395-285.386=0.009
max285.423-285.423=-0.000
mean1642.000-1634.000=8.000
σ0.000
min1642.000-1634.000=8.000
max1642.000-1634.000=8.000
mean0.377-0.383=-0.005
σ0.007-0.007=-0.001
min0.373-0.376=-0.003
max0.389-0.392=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1285.371-1285.372=-0.001
σ0.126-0.130=-0.004
min1285.311-1285.308=0.003
max1285.596-1285.604=-0.008
mean1642.000-1634.000=8.000
σ0.000
min1642.000-1634.000=8.000
max1642.000-1634.000=8.000
mean1.889-1.996=-0.107
σ0.140-0.240=-0.100
min1.718-1.752=-0.033
max2.074-2.372=-0.298
iters=5
new-facts=6402
prior-facts=1
mean1807.698-1807.704=-0.007
σ7.039-7.030=0.010
min1804.325-1804.328=-0.003
max1820.277-1820.264=0.012
mean1642.000-1634.000=8.000
σ0.000
min1642.000-1634.000=8.000
max1642.000-1634.000=8.000
mean4.187-4.158=0.028
σ0.327-0.218=0.110
min3.831-3.806=0.025
max4.626-4.403=0.223
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.200=-0.005
σ0.016-0.011=0.004
min2070.182-2070.192=-0.010
max2070.222-2070.220=0.003
mean1852.400-1839.000=13.400
σ175.256-176.770=-1.513
min1642.000-1634.000=8.000
max2096.000-2077.000=19.000
mean4.481-4.521=-0.041
σ0.127-0.052=0.075
min4.395-4.466=-0.071
max4.701-4.584=0.118

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.087-1.165=-0.078
σ0.219-0.323=-0.105
min0.887-0.906=-0.018
max1.404-1.692=-0.288

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.786-436.782=0.004
σ572.357-572.360=-0.003
min150.605-150.596=0.009
max1295.322-1295.322=-0.000
mean90.250
σ8.500
min86.000
max103.000
mean1642.000-1634.000=8.000
σ0.000
min1642.000-1634.000=8.000
max1642.000-1634.000=8.000
mean0.514-0.514=0.001
σ0.526-0.520=0.006
min0.250-0.252=-0.002
max1.303-1.293=0.010
policies=20
mean1506.274-1506.269=0.006
σ0.232-0.244=-0.012
min1506.123-1506.114=0.009
max1506.620-1506.632=-0.012
mean860.000
σ0.000
min860.000
max860.000
mean1642.000-1634.000=8.000
σ0.000
min1642.000-1634.000=8.000
max1642.000-1634.000=8.000
mean2.516-2.519=-0.003
σ0.011-0.016=-0.005
min2.508-2.506=0.002
max2.532-2.536=-0.005
policies=200
mean15070.319-15070.414=-0.095
σ0.095-0.063=0.031
min15070.244-15070.354=-0.110
max15070.449-15070.502=-0.053
mean8600.000
σ0.000
min8600.000
max8600.000
mean1642.000-1634.000=8.000
σ0.000
min1642.000-1634.000=8.000
max1642.000-1634.000=8.000
mean25.556-25.504=0.052
σ0.146-0.098=0.049
min25.428-25.388=0.039
max25.757-25.621=0.136