Compare commits

Home / Compare f522fdb2 .. 954c39b6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.570-70.567=0.004
σ0.044-0.045=-0.001
min70.545-70.544=0.001
max70.693-70.694=-0.001
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.154-0.154=0.000
σ0.006-0.004=0.001
min0.148-0.147=0.001
max0.163-0.162=0.002
cache=y
dps=1
iters=10
policies=100
mean21.292-21.294=-0.002
σ0.003-0.010=-0.007
min21.287-21.286=0.001
max21.297-21.322=-0.025
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.062=0.003
σ0.002-0.004=-0.002
min0.063-0.059=0.004
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.171-1753.171=0.000
σ0.364-0.361=0.002
min1752.604-1752.603=0.001
max1753.758-1753.758=0.000
mean1664.700-1672.950=-8.250
σ638.202-621.460=16.742
min623.000-688.000=-65.000
max2804.000-2717.000=87.000
mean2.768-2.845=-0.077
σ0.194-0.099=0.096
min2.311-2.644=-0.333
max3.033-3.096=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.617-271.614=0.002
σ0.009-0.008=0.001
min271.609-271.604=0.005
max271.631-271.626=0.005
mean2804.000-2717.000=87.000
σ0.000
min2804.000-2717.000=87.000
max2804.000-2717.000=87.000
mean0.377-0.374=0.003
σ0.007-0.007=0.000
min0.373-0.369=0.004
max0.390-0.386=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.047-1932.048=-0.001
σ0.010-0.012=-0.002
min1932.036-1932.038=-0.002
max1932.063-1932.068=-0.004
mean2804.000-2717.000=87.000
σ0.000
min2804.000-2717.000=87.000
max2804.000-2717.000=87.000
mean3.043-2.937=0.106
σ0.333-0.254=0.079
min2.528-2.500=0.029
max3.354-3.127=0.227
iters=5
new-facts=6402
prior-facts=1
mean4752.729-4752.835=-0.106
σ0.912-0.809=0.103
min4751.947-4752.407=-0.460
max4754.307-4754.278=0.029
mean2804.000-2717.000=87.000
σ0.000
min2804.000-2717.000=87.000
max2804.000-2717.000=87.000
mean8.074-8.016=0.059
σ0.293-0.378=-0.084
min7.819-7.683=0.136
max8.562-8.443=0.120
iters=5
new-facts=6402
prior-facts=6402
mean4943.234-4943.227=0.007
σ0.018-0.024=-0.006
min4943.211-4943.201=0.010
max4943.248-4943.263=-0.014
mean3034.600-3026.800=7.800
σ281.376-359.442=-78.066
min2804.000-2717.000=87.000
max3455.000-3554.000=-99.000
mean8.591-8.346=0.244
σ0.326-0.167=0.159
min8.299-8.151=0.148
max9.063-8.562=0.501

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.017=0.014
σ0.139-0.139=0.000
min0.936-0.920=0.015
max1.254-1.242=0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.291-472.290=0.001
σ575.932-575.926=0.006
min184.320-184.317=0.003
max1336.189-1336.179=0.011
mean88.250
σ8.500
min84.000
max101.000
mean2804.000-2717.000=87.000
σ0.000
min2804.000-2717.000=87.000
max2804.000-2717.000=87.000
mean0.494-0.558=-0.064
σ0.391-0.544=-0.153
min0.294-0.282=0.012
max1.080-1.374=-0.293
policies=20
mean1843.534-1843.528=0.006
σ0.369-0.388=-0.020
min1843.300-1843.259=0.042
max1844.080-1844.102=-0.022
mean840.000
σ0.000
min840.000
max840.000
mean2804.000-2717.000=87.000
σ0.000
min2804.000-2717.000=87.000
max2804.000-2717.000=87.000
mean2.886-2.858=0.028
σ0.045-0.033=0.011
min2.856-2.810=0.046
max2.952-2.884=0.067
policies=200
mean18442.039-18442.058=-0.019
σ0.468-0.485=-0.017
min18441.768-18441.762=0.005
max18442.739-18442.782=-0.043
mean8400.000
σ0.000
min8400.000
max8400.000
mean2804.000-2717.000=87.000
σ0.000
min2804.000-2717.000=87.000
max2804.000-2717.000=87.000
mean28.922-28.907=0.015
σ0.099-0.064=0.035
min28.806-28.821=-0.015
max29.042-28.973=0.070