Compare commits

Home / Compare 5ef5dc9f .. df846969

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.799=-0.000
σ0.106-0.108=-0.002
min35.753-35.751=0.003
max36.100-36.106=-0.006
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.076-0.076=-0.000
σ0.003-0.003=0.000
min0.073-0.074=-0.000
max0.082-0.082=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.002-0.004=-0.002
min26.060-26.054=0.006
max26.068-26.070=-0.003
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.061-0.061=-0.000
σ0.002-0.003=-0.001
min0.060-0.060=-0.000
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1755.921=0.003
σ0.368-0.366=0.002
min1755.354-1755.352=0.002
max1756.512-1756.497=0.015
mean1644.550-1668.250=-23.700
σ625.568-627.657=-2.088
min607.000-676.000=-69.000
max2656.000-2664.000=-8.000
mean2.882-2.792=0.090
σ0.144-0.193=-0.049
min2.658-2.283=0.375
max3.343-3.008=0.335

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.164-277.195=-0.031
σ0.008-0.006=0.003
min277.154-277.188=-0.034
max277.173-277.204=-0.031
mean2656.000-2664.000=-8.000
σ0.000
min2656.000-2664.000=-8.000
max2656.000-2664.000=-8.000
mean0.394-0.398=-0.005
σ0.004-0.011=-0.007
min0.391-0.390=0.001
max0.400-0.414=-0.014
iters=5
new-facts=1
prior-facts=6402
mean2174.424-2174.442=-0.018
σ0.005-0.017=-0.011
min2174.417-2174.428=-0.011
max2174.429-2174.469=-0.039
mean2656.000-2664.000=-8.000
σ0.000
min2656.000-2664.000=-8.000
max2656.000-2664.000=-8.000
mean2.868-2.982=-0.114
σ0.137-0.169=-0.032
min2.761-2.709=0.052
max3.101-3.153=-0.052
iters=5
new-facts=6402
prior-facts=1
mean5052.539-5052.624=-0.085
σ1.063-0.980=0.083
min5051.681-5052.017=-0.336
max5054.381-5054.363=0.019
mean2656.000-2664.000=-8.000
σ0.000
min2656.000-2664.000=-8.000
max2656.000-2664.000=-8.000
mean8.862-8.684=0.178
σ0.710-0.611=0.099
min8.162-8.095=0.067
max9.818-9.589=0.229
iters=5
new-facts=6402
prior-facts=6402
mean5188.279-5188.430=-0.151
σ0.195-0.090=0.105
min5188.010-5188.345=-0.335
max5188.523-5188.527=-0.004
mean3284.200-3220.800=63.400
σ496.906-384.962=111.944
min2656.000-2667.000=-11.000
max3891.000-3688.000=203.000
mean8.799-8.948=-0.149
σ0.118-0.284=-0.165
min8.659-8.712=-0.053
max8.938-9.412=-0.474

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.249-1.238=0.011
σ0.285-0.348=-0.062
min1.080-0.956=0.124
max1.741-1.831=-0.090

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.858-464.856=0.003
σ572.657-572.660=-0.002
min178.525-178.523=0.003
max1323.844-1323.845=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean2656.000-2664.000=-8.000
σ0.000
min2656.000-2664.000=-8.000
max2656.000-2664.000=-8.000
mean0.572-0.552=0.020
σ0.578-0.526=0.052
min0.278-0.281=-0.002
max1.439-1.340=0.099
policies=20
mean1785.485-1785.461=0.025
σ0.346-0.346=0.001
min1785.249-1785.228=0.022
max1785.998-1785.973=0.025
mean760.000
σ0.000
min760.000
max760.000
mean2656.000-2664.000=-8.000
σ0.000
min2656.000-2664.000=-8.000
max2656.000-2664.000=-8.000
mean2.800-2.785=0.015
σ0.039-0.012=0.026
min2.778-2.773=0.005
max2.857-2.797=0.060
policies=200
mean17861.377-17861.450=-0.073
σ0.121-0.524=-0.403
min17861.301-17861.048=0.254
max17861.557-17862.219=-0.662
mean7600.000
σ0.000
min7600.000
max7600.000
mean2656.000-2664.000=-8.000
σ0.000
min2656.000-2664.000=-8.000
max2656.000-2664.000=-8.000
mean28.277-28.223=0.054
σ0.316-0.121=0.195
min27.981-28.125=-0.145
max28.601-28.382=0.220