Compare commits

Home / Compare cbab7657 .. 134cd4ee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.564=0.000
σ0.046-0.050=-0.004
min70.537-70.536=0.001
max70.694-70.703=-0.010
mean413.000-413.300=-0.300
σ0.000-0.483=-0.483
min413.000
max413.000-414.000=-1.000
mean0.158-0.159=-0.001
σ0.005-0.003=0.002
min0.150-0.156=-0.007
max0.165-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.290=-0.003
σ0.002-0.012=-0.010
min21.284-21.283=0.001
max21.290-21.323=-0.033
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.058-0.063=-0.005
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.172-1753.174=-0.002
σ0.362-0.362=0.001
min1752.612-1752.605=0.007
max1753.753-1753.759=-0.006
mean1663.200-1647.800=15.400
σ631.198-633.346=-2.148
min686.000-632.000=54.000
max2802.000-2775.000=27.000
mean2.843-2.805=0.039
σ0.109-0.177=-0.068
min2.587-2.351=0.236
max3.121-3.010=0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.620-271.616=0.004
σ0.008-0.008=0.000
min271.608-271.611=-0.003
max271.628-271.629=-0.001
mean2802.000-2775.000=27.000
σ0.000
min2802.000-2775.000=27.000
max2802.000-2775.000=27.000
mean0.382-0.384=-0.002
σ0.006-0.007=-0.001
min0.378-0.379=-0.001
max0.392-0.396=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.049-1932.049=0.000
σ0.022-0.017=0.005
min1932.016-1932.031=-0.015
max1932.073-1932.076=-0.004
mean2802.000-2775.000=27.000
σ0.000
min2802.000-2775.000=27.000
max2802.000-2775.000=27.000
mean2.912-2.938=-0.027
σ0.256-0.272=-0.016
min2.470-2.506=-0.036
max3.085-3.228=-0.144
iters=5
new-facts=6402
prior-facts=1
mean4752.800-4752.859=-0.059
σ0.876-0.776=0.100
min4752.304-4752.472=-0.168
max4754.361-4754.246=0.114
mean2802.000-2775.000=27.000
σ0.000
min2802.000-2775.000=27.000
max2802.000-2775.000=27.000
mean8.479-7.901=0.578
σ0.404-0.246=0.158
min7.956-7.658=0.298
max9.002-8.281=0.722
iters=5
new-facts=6402
prior-facts=6402
mean4943.242-4943.232=0.010
σ0.013-0.019=-0.006
min4943.228-4943.208=0.020
max4943.256-4943.257=-0.000
mean2999.400-3052.800=-53.400
σ204.251-338.134=-133.884
min2802.000-2775.000=27.000
max3303.000-3562.000=-259.000
mean8.493-8.465=0.028
σ0.114-0.092=0.021
min8.364-8.377=-0.013
max8.618-8.598=0.020

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.011-1.073=-0.063
σ0.175-0.116=0.059
min0.929-0.933=-0.004
max1.323-1.255=0.068

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.292-472.297=-0.005
σ575.915-575.924=-0.008
min184.325-184.326=-0.001
max1336.165-1336.182=-0.018
mean88.250
σ8.500
min84.000
max101.000
mean2802.000-2775.000=27.000
σ0.000
min2802.000-2775.000=27.000
max2802.000-2775.000=27.000
mean0.532-0.485=0.047
σ0.352-0.373=-0.020
min0.303-0.297=0.006
max1.047-1.044=0.003
policies=20
mean1843.541-1843.587=-0.046
σ0.353-0.366=-0.013
min1843.301-1843.308=-0.006
max1844.058-1844.118=-0.059
mean840.000
σ0.000
min840.000
max840.000
mean2802.000-2775.000=27.000
σ0.000
min2802.000-2775.000=27.000
max2802.000-2775.000=27.000
mean2.912-2.971=-0.058
σ0.049-0.157=-0.108
min2.869-2.858=0.012
max2.969-3.196=-0.227
policies=200
mean18442.144-18442.223=-0.079
σ0.496-0.498=-0.002
min18441.762-18441.910=-0.149
max18442.867-18442.965=-0.098
mean8400.000
σ0.000
min8400.000
max8400.000
mean2802.000-2775.000=27.000
σ0.000
min2802.000-2775.000=27.000
max2802.000-2775.000=27.000
mean29.062-28.989=0.072
σ0.147-0.209=-0.062
min28.856-28.808=0.048
max29.203-29.170=0.033