Compare commits

Home / Compare 9abb04d1 .. 4df259a5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.566=0.001
σ0.043-0.049=-0.006
min70.542-70.534=0.008
max70.686-70.702=-0.017
mean415.000
σ0.000
min415.000
max415.000
mean0.161-0.157=0.004
σ0.003-0.005=-0.001
min0.157-0.150=0.007
max0.166-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.000
σ0.002-0.003=-0.001
min21.283-21.284=-0.000
max21.291-21.294=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.065=-0.000
σ0.002-0.002=-0.000
min0.063-0.063=0.001
max0.069-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.569=-0.001
σ0.361-0.361=0.000
min1752.998-1752.998=0.000
max1754.155-1754.152=0.003
mean1656.650-1654.950=1.700
σ643.662-643.194=0.468
min628.000-627.000=1.000
max2888.000-2886.000=2.000
mean2.808-2.810=-0.003
σ0.132-0.231=-0.099
min2.495-2.180=0.315
max2.962-3.023=-0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.015-272.015=0.000
σ0.005-0.006=-0.001
min272.009-272.005=0.004
max272.023-272.020=0.003
mean2888.000-2886.000=2.000
σ0.000
min2888.000-2886.000=2.000
max2888.000-2886.000=2.000
mean0.387-0.384=0.003
σ0.009-0.009=0.000
min0.377-0.377=-0.001
max0.395-0.400=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.443-1932.436=0.007
σ0.008-0.015=-0.006
min1932.433-1932.410=0.023
max1932.456-1932.445=0.011
mean2888.000-2886.000=2.000
σ0.000
min2888.000-2886.000=2.000
max2888.000-2886.000=2.000
mean2.984-2.974=0.011
σ0.195-0.120=0.075
min2.702-2.775=-0.073
max3.252-3.080=0.171
iters=5
new-facts=6402
prior-facts=1
mean4753.132-4753.103=0.028
σ0.896-0.955=-0.059
min4752.334-4752.272=0.062
max4754.675-4754.748=-0.073
mean2888.000-2886.000=2.000
σ0.000
min2888.000-2886.000=2.000
max2888.000-2886.000=2.000
mean7.913-8.249=-0.336
σ0.332-0.425=-0.093
min7.718-7.850=-0.132
max8.494-8.904=-0.410
iters=5
new-facts=6402
prior-facts=6402
mean4943.631-4943.598=0.033
σ0.016-0.037=-0.021
min4943.607-4943.536=0.070
max4943.647-4943.634=0.013
mean3091.400-3095.400=-4.000
σ285.164-292.037=-6.874
min2888.000-2886.000=2.000
max3537.000-3554.000=-17.000
mean8.402-8.410=-0.008
σ0.130-0.130=-0.000
min8.300-8.264=0.036
max8.610-8.613=-0.003

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.042-1.055=-0.013
σ0.177-0.281=-0.103
min0.934-0.925=0.009
max1.344-1.557=-0.213

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-473.086=-0.004
σ575.915-575.925=-0.010
min185.119-185.111=0.008
max1336.954-1336.973=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2888.000-2886.000=2.000
σ0.000
min2888.000-2886.000=2.000
max2888.000-2886.000=2.000
mean0.458-0.485=-0.027
σ0.319-0.374=-0.055
min0.294-0.298=-0.003
max0.937-1.046=-0.109
policies=20
mean1851.457-1851.454=0.003
σ0.390-0.347=0.043
min1851.163-1851.195=-0.032
max1852.023-1851.959=0.064
mean840.000
σ0.000
min840.000
max840.000
mean2888.000-2886.000=2.000
σ0.000
min2888.000-2886.000=2.000
max2888.000-2886.000=2.000
mean2.965-2.946=0.019
σ0.051-0.005=0.045
min2.930-2.938=-0.008
max3.040-2.950=0.090
policies=200
mean18521.185-18521.077=0.108
σ0.361-0.534=-0.173
min18520.935-18520.716=0.220
max18521.719-18521.863=-0.145
mean8400.000
σ0.000
min8400.000
max8400.000
mean2888.000-2886.000=2.000
σ0.000
min2888.000-2886.000=2.000
max2888.000-2886.000=2.000
mean29.261-29.333=-0.072
σ0.537-0.396=0.141
min28.769-28.981=-0.212
max29.835-29.777=0.058