Compare commits

Home / Compare 9f4c61bb .. 7c63bb12

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.565=0.001
σ0.046-0.046=0.000
min70.536-70.536=0.000
max70.694-70.693=0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.159-0.155=0.004
σ0.003-0.005=-0.002
min0.156-0.147=0.008
max0.164-0.164=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.001
σ0.002-0.003=-0.001
min21.285-21.283=0.002
max21.292-21.291=0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.062-0.064=-0.002
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.066-0.069=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.567=0.001
σ0.361-0.360=0.001
min1752.999-1752.998=0.001
max1754.154-1754.152=0.001
mean1668.200-1652.350=15.850
σ627.899-641.702=-13.803
min688.000-634.000=54.000
max2768.000-2884.000=-116.000
mean2.854-2.749=0.106
σ0.106-0.215=-0.109
min2.585-2.146=0.438
max3.118-2.974=0.145

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.013-272.019=-0.006
σ0.008-0.004=0.005
min272.000-272.015=-0.014
max272.022-272.025=-0.003
mean2768.000-2884.000=-116.000
σ0.000
min2768.000-2884.000=-116.000
max2768.000-2884.000=-116.000
mean0.386-0.393=-0.006
σ0.007-0.006=0.001
min0.381-0.387=-0.007
max0.395-0.402=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1932.432-1932.437=-0.005
σ0.008-0.005=0.003
min1932.420-1932.430=-0.011
max1932.439-1932.443=-0.004
mean2768.000-2884.000=-116.000
σ0.000
min2768.000-2884.000=-116.000
max2768.000-2884.000=-116.000
mean2.973-3.022=-0.049
σ0.085-0.068=0.017
min2.889-2.976=-0.088
max3.097-3.141=-0.044
iters=5
new-facts=6402
prior-facts=1
mean4753.161-4753.187=-0.026
σ0.829-0.800=0.030
min4752.606-4752.679=-0.073
max4754.622-4754.607=0.015
mean2768.000-2884.000=-116.000
σ0.000
min2768.000-2884.000=-116.000
max2768.000-2884.000=-116.000
mean8.585-8.363=0.222
σ0.462-0.384=0.079
min8.215-7.817=0.398
max9.267-8.838=0.430
iters=5
new-facts=6402
prior-facts=6402
mean4943.633-4943.632=0.001
σ0.013-0.028=-0.015
min4943.618-4943.597=0.021
max4943.647-4943.665=-0.018
mean3001.800-3067.000=-65.200
σ228.981-195.553=33.428
min2768.000-2884.000=-116.000
max3336.000-3355.000=-19.000
mean8.501-8.498=0.003
σ0.081-0.164=-0.084
min8.415-8.358=0.057
max8.616-8.753=-0.136

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.004-1.023=-0.019
σ0.139-0.188=-0.049
min0.938-0.926=0.012
max1.253-1.359=-0.106

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.083-473.081=0.002
σ575.914-575.914=-0.000
min185.117-185.116=0.002
max1336.953-1336.952=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2768.000-2884.000=-116.000
σ0.000
min2768.000-2884.000=-116.000
max2768.000-2884.000=-116.000
mean0.450-0.448=0.002
σ0.303-0.302=0.001
min0.296-0.294=0.002
max0.905-0.902=0.003
policies=20
mean1851.454-1851.441=0.014
σ0.331-0.373=-0.043
min1851.204-1851.174=0.030
max1851.938-1851.986=-0.048
mean840.000
σ0.000
min840.000
max840.000
mean2768.000-2884.000=-116.000
σ0.000
min2768.000-2884.000=-116.000
max2768.000-2884.000=-116.000
mean2.905-2.937=-0.032
σ0.110-0.006=0.104
min2.839-2.930=-0.091
max3.067-2.944=0.123
policies=200
mean18521.172-18520.678=0.494
σ0.525-0.758=-0.233
min18520.889-18519.684=1.205
max18521.959-18521.529=0.430
mean8400.000
σ0.000
min8400.000
max8400.000
mean2768.000-2884.000=-116.000
σ0.000
min2768.000-2884.000=-116.000
max2768.000-2884.000=-116.000
mean28.869-29.175=-0.306
σ0.138-0.432=-0.295
min28.722-28.799=-0.077
max29.054-29.640=-0.586