Compare commits

Home / Compare ee14baf0 .. a2fd9861

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.561=0.004
σ0.045-0.046=-0.001
min70.540-70.539=0.001
max70.689-70.690=-0.001
mean413.400-414.400=-1.000
σ0.516
min413.000-414.000=-1.000
max414.000-415.000=-1.000
mean0.157-0.156=0.001
σ0.006-0.005=0.001
min0.151-0.149=0.001
max0.169-0.166=0.003
cache=y
dps=1
iters=10
policies=100
mean21.288-21.292=-0.004
σ0.002-0.011=-0.009
min21.284-21.284=0.000
max21.291-21.323=-0.031
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.065=0.000
σ0.003-0.003=0.000
min0.063-0.063=0.000
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.568=-0.000
σ0.359-0.361=-0.002
min1752.999-1752.998=0.000
max1754.154-1754.141=0.013
mean1666.800-1642.800=24.000
σ647.044-630.591=16.452
min688.000-628.000=60.000
max2774.000-2851.000=-77.000
mean2.810-2.796=0.014
σ0.151-0.154=-0.004
min2.445-2.323=0.122
max2.977-3.016=-0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.014-272.015=-0.001
σ0.007-0.004=0.004
min272.002-272.011=-0.009
max272.022-272.020=0.002
mean2774.000-2851.000=-77.000
σ0.000
min2774.000-2851.000=-77.000
max2774.000-2851.000=-77.000
mean0.390-0.382=0.008
σ0.011-0.012=-0.001
min0.378-0.370=0.009
max0.403-0.402=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.437-1932.442=-0.005
σ0.013-0.010=0.003
min1932.413-1932.428=-0.014
max1932.445-1932.457=-0.011
mean2774.000-2851.000=-77.000
σ0.000
min2774.000-2851.000=-77.000
max2774.000-2851.000=-77.000
mean3.028-3.146=-0.119
σ0.066-0.267=-0.201
min2.965-2.985=-0.019
max3.124-3.613=-0.489
iters=5
new-facts=6402
prior-facts=1
mean4752.941-4753.171=-0.230
σ0.701-0.811=-0.110
min4752.222-4752.698=-0.477
max4754.115-4754.609=-0.494
mean2774.000-2851.000=-77.000
σ0.000
min2774.000-2851.000=-77.000
max2774.000-2851.000=-77.000
mean8.559-8.449=0.110
σ0.043-0.541=-0.498
min8.494-7.631=0.863
max8.608-8.943=-0.335
iters=5
new-facts=6402
prior-facts=6402
mean4943.634-4943.635=-0.001
σ0.018-0.026=-0.008
min4943.618-4943.603=0.015
max4943.655-4943.665=-0.010
mean3027.800-3080.800=-53.000
σ233.821-232.578=1.242
min2774.000-2851.000=-77.000
max3327.000-3316.000=11.000
mean8.680-8.752=-0.072
σ0.223-0.361=-0.138
min8.413-8.364=0.049
max8.867-9.309=-0.442

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.082-1.082=0.000
σ0.110-0.265=-0.155
min0.942-0.933=0.009
max1.250-1.545=-0.295

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.093-473.080=0.014
σ575.946-575.914=0.032
min185.108-185.117=-0.009
max1337.013-1336.951=0.062
mean88.250
σ8.500
min84.000
max101.000
mean2774.000-2851.000=-77.000
σ0.000
min2774.000-2851.000=-77.000
max2774.000-2851.000=-77.000
mean0.563-0.448=0.115
σ0.545-0.302=0.243
min0.287-0.296=-0.009
max1.380-0.900=0.480
policies=20
mean1851.427-1851.432=-0.005
σ0.371-0.377=-0.006
min1851.175-1851.155=0.020
max1851.975-1851.984=-0.008
mean840.000
σ0.000
min840.000
max840.000
mean2774.000-2851.000=-77.000
σ0.000
min2774.000-2851.000=-77.000
max2774.000-2851.000=-77.000
mean2.875-2.924=-0.049
σ0.039-0.019=0.020
min2.849-2.901=-0.052
max2.932-2.947=-0.015
policies=200
mean18520.855-18521.073=-0.218
σ0.497-0.573=-0.075
min18520.499-18520.735=-0.236
max18521.571-18521.927=-0.355
mean8400.000
σ0.000
min8400.000
max8400.000
mean2774.000-2851.000=-77.000
σ0.000
min2774.000-2851.000=-77.000
max2774.000-2851.000=-77.000
mean28.737-29.007=-0.270
σ0.012-0.431=-0.419
min28.723-28.674=0.050
max28.748-29.621=-0.874