Compare commits

Home / Compare 0c80b7be .. a161d5fc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.566=-0.001
σ0.045-0.045=0.000
min70.538-70.540=-0.002
max70.688-70.689=-0.001
mean412.000-412.200=-0.200
σ0.000-0.422=-0.422
min412.000
max412.000-413.000=-1.000
mean0.155-0.157=-0.002
σ0.006-0.005=0.001
min0.148-0.150=-0.002
max0.166-0.163=0.003
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.000
σ0.002-0.003=-0.001
min21.284-21.282=0.002
max21.290-21.291=-0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.062-0.062=-0.000
σ0.003-0.004=-0.000
min0.058-0.059=-0.001
max0.069-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.655-1753.655=0.000
σ0.359-0.360=-0.001
min1753.082-1753.085=-0.003
max1754.244-1754.238=0.006
mean1655.700-1654.800=0.900
σ630.822-622.487=8.335
min641.000-667.000=-26.000
max2853.000-2658.000=195.000
mean2.847-2.830=0.017
σ0.125-0.155=-0.030
min2.450-2.373=0.078
max3.055-3.040=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.098-272.099=-0.001
σ0.007-0.007=0.000
min272.089-272.090=-0.001
max272.106-272.109=-0.003
mean2853.000-2658.000=195.000
σ0.000
min2853.000-2658.000=195.000
max2853.000-2658.000=195.000
mean0.394-0.394=-0.000
σ0.013-0.014=-0.000
min0.380-0.379=0.001
max0.412-0.412=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1932.541-1932.514=0.027
σ0.024-0.006=0.018
min1932.516-1932.506=0.009
max1932.567-1932.523=0.045
mean2853.000-2658.000=195.000
σ0.000
min2853.000-2658.000=195.000
max2853.000-2658.000=195.000
mean2.693-2.950=-0.257
σ0.332-0.243=0.089
min2.387-2.556=-0.169
max3.073-3.181=-0.108
iters=5
new-facts=6402
prior-facts=1
mean4753.288-4753.278=0.009
σ0.838-0.842=-0.004
min4752.746-4752.844=-0.098
max4754.774-4754.782=-0.008
mean2853.000-2658.000=195.000
σ0.000
min2853.000-2658.000=195.000
max2853.000-2658.000=195.000
mean8.200-8.441=-0.241
σ0.614-0.363=0.251
min7.740-7.822=-0.082
max9.146-8.788=0.358
iters=5
new-facts=6402
prior-facts=6402
mean4943.639-4943.717=-0.078
σ0.156-0.018=0.138
min4943.361-4943.694=-0.334
max4943.717-4943.736=-0.019
mean3078.200-3035.400=42.800
σ298.745-290.578=8.168
min2853.000-2658.000=195.000
max3538.000-3417.000=121.000
mean8.447-8.612=-0.166
σ0.141-0.149=-0.007
min8.360-8.428=-0.068
max8.691-8.798=-0.107

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.116-1.110=0.006
σ0.199-0.130=0.069
min0.928-0.936=-0.008
max1.333-1.240=0.093

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.309-472.292=0.017
σ575.928-575.933=-0.005
min184.335-184.320=0.015
max1336.200-1336.190=0.010
mean88.250
σ8.500
min84.000
max101.000
mean2853.000-2658.000=195.000
σ0.000
min2853.000-2658.000=195.000
max2853.000-2658.000=195.000
mean0.488-0.569=-0.081
σ0.378-0.563=-0.185
min0.298-0.286=0.012
max1.055-1.414=-0.359
policies=20
mean1843.719-1843.558=0.161
σ0.377-0.381=-0.004
min1843.433-1843.301=0.133
max1844.262-1844.121=0.141
mean840.000
σ0.000
min840.000
max840.000
mean2853.000-2658.000=195.000
σ0.000
min2853.000-2658.000=195.000
max2853.000-2658.000=195.000
mean2.966-2.884=0.083
σ0.030-0.030=0.000
min2.939-2.861=0.079
max2.995-2.928=0.067
policies=200
mean18442.702-18442.216=0.486
σ0.713-0.463=0.250
min18441.787-18441.953=-0.166
max18443.524-18442.909=0.615
mean8400.000
σ0.000
min8400.000
max8400.000
mean2853.000-2658.000=195.000
σ0.000
min2853.000-2658.000=195.000
max2853.000-2658.000=195.000
mean29.398-29.023=0.375
σ0.545-0.104=0.442
min28.777-28.910=-0.133
max30.069-29.161=0.908