Compare commits

Home / Compare 8d3e2709 .. 468da384

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.394-70.392=0.002
σ0.045-0.044=0.001
min70.370-70.370=-0.000
max70.521-70.517=0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.161-0.159=0.002
σ0.004-0.005=-0.001
min0.152-0.152=0.000
max0.167-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.147-21.148=-0.001
σ0.009-0.010=-0.000
min21.140-21.140=-0.001
max21.172-21.175=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.063-0.064=-0.001
σ0.002-0.003=-0.000
min0.057-0.062=-0.006
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.394=0.001
σ0.361-0.363=-0.001
min1751.826-1751.827=-0.001
max1752.989-1752.981=0.008
mean1662.350-1658.400=3.950
σ634.625-631.125=3.501
min618.000-626.000=-8.000
max2777.000-2757.000=20.000
mean2.783-2.818=-0.035
σ0.235-0.129=0.106
min2.191-2.328=-0.136
max3.113-2.945=0.168

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.238-270.238=0.000
σ0.005-0.008=-0.003
min270.233-270.228=0.006
max270.246-270.249=-0.004
mean2777.000-2757.000=20.000
σ0.000
min2777.000-2757.000=20.000
max2777.000-2757.000=20.000
mean0.383-0.383=0.000
σ0.005-0.008=-0.003
min0.379-0.378=0.001
max0.392-0.397=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.694-1930.702=-0.008
σ0.017-0.009=0.008
min1930.667-1930.689=-0.022
max1930.706-1930.711=-0.005
mean2777.000-2757.000=20.000
σ0.000
min2777.000-2757.000=20.000
max2777.000-2757.000=20.000
mean2.636-2.506=0.130
σ0.260-0.075=0.186
min2.460-2.454=0.006
max3.089-2.638=0.451
iters=5
new-facts=6402
prior-facts=1
mean4751.294-4751.398=-0.104
σ0.662-0.865=-0.203
min4750.877-4750.877=-0.001
max4752.456-4752.934=-0.478
mean2777.000-2757.000=20.000
σ0.000
min2777.000-2757.000=20.000
max2777.000-2757.000=20.000
mean8.752-8.561=0.191
σ0.574-0.503=0.072
min7.841-7.775=0.066
max9.394-9.102=0.292
iters=5
new-facts=6402
prior-facts=6402
mean4941.865-4941.726=0.139
σ0.022-0.197=-0.175
min4941.847-4941.506=0.341
max4941.893-4941.895=-0.001
mean2998.800-3010.000=-11.200
σ219.121-235.963=-16.841
min2777.000-2757.000=20.000
max3309.000-3318.000=-9.000
mean8.566-8.611=-0.045
σ0.121-0.239=-0.117
min8.466-8.387=0.079
max8.751-8.933=-0.182

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.989-1.078=-0.089
σ0.140-0.116=0.025
min0.919-0.934=-0.015
max1.240-1.258=-0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.753-466.758=-0.005
σ575.931-575.942=-0.011
min178.783-178.780=0.003
max1330.650-1330.671=-0.021
mean86.250
σ8.500
min82.000
max99.000
mean2777.000-2757.000=20.000
σ0.000
min2777.000-2757.000=20.000
max2777.000-2757.000=20.000
mean0.443-0.552=-0.109
σ0.300-0.539=-0.238
min0.291-0.282=0.010
max0.893-1.360=-0.467
policies=20
mean1788.155-1788.095=0.059
σ0.356-0.352=0.005
min1787.907-1787.885=0.022
max1788.680-1788.621=0.059
mean820.000
σ0.000
min820.000
max820.000
mean2777.000-2757.000=20.000
σ0.000
min2777.000-2757.000=20.000
max2777.000-2757.000=20.000
mean2.869-2.792=0.077
σ0.119-0.023=0.096
min2.785-2.774=0.011
max3.041-2.825=0.216
policies=200
mean17888.124-17888.074=0.050
σ0.366-0.614=-0.248
min17887.907-17887.667=0.240
max17888.670-17888.980=-0.310
mean8200.000
σ0.000
min8200.000
max8200.000
mean2777.000-2757.000=20.000
σ0.000
min2777.000-2757.000=20.000
max2777.000-2757.000=20.000
mean28.128-28.105=0.022
σ0.192-0.154=0.038
min27.999-27.978=0.020
max28.412-28.327=0.085