Compare commits

Home / Compare e0a2f632 .. a9f025b3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.797=0.002
σ0.106-0.109=-0.003
min35.753-35.746=0.007
max36.099-36.105=-0.006
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.077-0.067=0.010
σ0.003-0.016=-0.013
min0.074-0.044=0.031
max0.083-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.064=-0.000
σ0.003-0.004=-0.001
min26.058-26.059=-0.001
max26.069-26.071=-0.002
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.059-0.056=0.004
σ0.003-0.006=-0.003
min0.056-0.047=0.009
max0.065-0.061=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.923=-0.001
σ0.366-0.368=-0.001
min1755.347-1755.350=-0.003
max1756.514-1756.521=-0.006
mean1665.850-1667.950=-2.100
σ628.210-628.755=-0.545
min673.000-675.000=-2.000
max2663.000-2666.000=-3.000
mean2.808-2.848=-0.040
σ0.158-0.109=0.049
min2.363-2.612=-0.249
max3.002-3.010=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.197-277.196=0.001
σ0.006-0.006=0.000
min277.190-277.191=-0.002
max277.205-277.206=-0.002
mean2663.000-2666.000=-3.000
σ0.000
min2663.000-2666.000=-3.000
max2663.000-2666.000=-3.000
mean0.410-0.406=0.004
σ0.010-0.010=0.000
min0.402-0.401=0.001
max0.421-0.424=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2174.406-2174.428=-0.021
σ0.018-0.011=0.007
min2174.390-2174.409=-0.020
max2174.431-2174.438=-0.007
mean2663.000-2666.000=-3.000
σ0.000
min2663.000-2666.000=-3.000
max2663.000-2666.000=-3.000
mean2.902-2.950=-0.048
σ0.150-0.130=0.020
min2.785-2.770=0.015
max3.118-3.125=-0.007
iters=5
new-facts=6402
prior-facts=1
mean5052.508-5052.406=0.102
σ1.063-0.806=0.256
min5051.754-5051.652=0.102
max5054.384-5053.765=0.619
mean2663.000-2666.000=-3.000
σ0.000
min2663.000-2666.000=-3.000
max2663.000-2666.000=-3.000
mean9.023-8.760=0.264
σ0.734-0.542=0.192
min8.006-8.136=-0.131
max9.758-9.460=0.298
iters=5
new-facts=6402
prior-facts=6402
mean5188.410-5188.430=-0.020
σ0.103-0.087=0.016
min5188.311-5188.361=-0.051
max5188.524-5188.531=-0.008
mean3221.200-3296.200=-75.000
σ479.814-417.306=62.508
min2663.000-2712.000=-49.000
max3873.000-3682.000=191.000
mean8.752-8.929=-0.177
σ0.196-0.303=-0.106
min8.578-8.691=-0.113
max9.089-9.457=-0.367

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.169-1.345=-0.176
σ0.351-0.326=0.025
min0.953-1.068=-0.115
max1.789-1.826=-0.037

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.859-464.857=0.002
σ572.666-572.659=0.007
min178.523-178.524=-0.001
max1323.858-1323.846=0.012
mean79.500
σ7.000
min76.000
max90.000
mean2663.000-2666.000=-3.000
σ0.000
min2663.000-2666.000=-3.000
max2663.000-2666.000=-3.000
mean0.578-0.546=0.032
σ0.587-0.516=0.071
min0.283-0.281=0.002
max1.459-1.320=0.139
policies=20
mean1785.464-1785.487=-0.023
σ0.345-0.342=0.002
min1785.237-1785.254=-0.017
max1785.976-1785.995=-0.018
mean760.000
σ0.000
min760.000
max760.000
mean2663.000-2666.000=-3.000
σ0.000
min2663.000-2666.000=-3.000
max2663.000-2666.000=-3.000
mean2.785-2.792=-0.007
σ0.006-0.023=-0.016
min2.780-2.764=0.016
max2.793-2.818=-0.025
policies=200
mean17861.508-17861.486=0.023
σ0.552-0.373=0.179
min17861.104-17861.259=-0.156
max17862.324-17862.043=0.280
mean7600.000
σ0.000
min7600.000
max7600.000
mean2663.000-2666.000=-3.000
σ0.000
min2663.000-2666.000=-3.000
max2663.000-2666.000=-3.000
mean28.180-28.173=0.006
σ0.169-0.145=0.024
min27.958-28.000=-0.042
max28.319-28.308=0.011