Compare commits

Home / Compare 956b8413 .. fb29ae2b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.772-35.798=-5.027
σ0.046-0.105=-0.059
min30.748-35.756=-5.008
max30.900-36.095=-5.195
mean415.000-411.900=3.100
σ0.000-0.316=-0.316
min415.000-411.000=4.000
max415.000-412.000=3.000
mean0.076-0.076=0.001
σ0.005-0.003=0.002
min0.071-0.073=-0.002
max0.085-0.082=0.004
cache=y
dps=1
iters=10
policies=100
mean21.059-26.065=-5.007
σ0.002-0.004=-0.002
min21.056-26.060=-5.004
max21.062-26.072=-5.010
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.064-0.061=0.003
σ0.003-0.003=-0.000
min0.062-0.059=0.003
max0.071-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1751.236=0.001
σ0.361-0.361=-0.000
min1750.667-1750.665=0.002
max1751.821-1751.807=0.013
mean1664.350-1633.150=31.200
σ632.126-612.935=19.191
min682.000-629.000=53.000
max2704.000-2464.000=240.000
mean2.852-2.806=0.046
σ0.136-0.193=-0.057
min2.418-2.196=0.222
max3.026-3.068=-0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.569-275.561=0.008
σ0.008-0.013=-0.005
min275.561-275.539=0.022
max275.579-275.572=0.007
mean2704.000-2464.000=240.000
σ0.000
min2704.000-2464.000=240.000
max2704.000-2464.000=240.000
mean0.401-0.394=0.007
σ0.015-0.008=0.007
min0.385-0.385=-0.001
max0.421-0.404=0.016
iters=5
new-facts=1
prior-facts=6402
mean2168.088-2168.083=0.004
σ0.026-0.011=0.015
min2168.045-2168.073=-0.029
max2168.113-2168.101=0.012
mean2704.000-2464.000=240.000
σ0.000
min2704.000-2464.000=240.000
max2704.000-2464.000=240.000
mean2.985-3.011=-0.026
σ0.167-0.155=0.013
min2.806-2.796=0.010
max3.168-3.135=0.033
iters=5
new-facts=6402
prior-facts=1
mean5047.782-5047.901=-0.119
σ0.651-0.911=-0.260
min5047.368-5047.364=0.004
max5048.937-5049.523=-0.586
mean2704.000-2464.000=240.000
σ0.000
min2704.000-2464.000=240.000
max2704.000-2464.000=240.000
mean8.789-8.803=-0.014
σ0.371-0.384=-0.012
min8.203-8.217=-0.014
max9.104-9.151=-0.047
iters=5
new-facts=6402
prior-facts=6402
mean5178.905-5179.048=-0.144
σ0.236-0.090=0.145
min5178.636-5178.962=-0.325
max5179.126-5179.156=-0.030
mean3217.800-3224.800=-7.000
σ379.377-359.297=20.081
min2704.000-2719.000=-15.000
max3699.000-3667.000=32.000
mean9.841-9.716=0.125
σ0.208-0.502=-0.294
min9.594-8.996=0.598
max10.072-10.197=-0.125

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.102-1.807=-0.705
σ0.137-0.137=-0.000
min0.969-1.638=-0.669
max1.285-2.014=-0.729

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.204-463.194=0.010
σ572.661-572.650=0.011
min176.868-176.867=0.001
max1322.195-1322.168=0.027
mean77.500
σ7.000
min74.000
max88.000
mean2704.000-2464.000=240.000
σ0.000
min2704.000-2464.000=240.000
max2704.000-2464.000=240.000
mean0.541-0.551=-0.009
σ0.538-0.547=-0.009
min0.263-0.273=-0.010
max1.348-1.371=-0.023
policies=20
mean1768.965-1768.966=-0.001
σ0.335-0.348=-0.014
min1768.743-1768.732=0.011
max1769.463-1769.483=-0.020
mean740.000
σ0.000
min740.000
max740.000
mean2704.000-2464.000=240.000
σ0.000
min2704.000-2464.000=240.000
max2704.000-2464.000=240.000
mean2.749-2.753=-0.004
σ0.017-0.010=0.007
min2.725-2.739=-0.014
max2.762-2.761=0.001
policies=200
mean17696.090-17696.235=-0.146
σ0.614-0.468=0.147
min17695.741-17695.988=-0.247
max17697.009-17696.936=0.072
mean7400.000
σ0.000
min7400.000
max7400.000
mean2704.000-2464.000=240.000
σ0.000
min2704.000-2464.000=240.000
max2704.000-2464.000=240.000
mean27.700-27.757=-0.056
σ0.191-0.100=0.091
min27.480-27.641=-0.161
max27.884-27.882=0.002