Compare commits

Home / Compare 23e3e89e .. d7e3f272

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.976-35.975=0.001
σ0.107-0.108=-0.001
min35.933-35.933=-0.000
max36.279-36.281=-0.002
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.076-0.078=-0.001
σ0.003-0.004=-0.001
min0.074-0.075=-0.001
max0.083-0.083=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=0.000
σ0.004-0.003=0.001
min26.201-26.204=-0.004
max26.213-26.212=0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.059-0.060=-0.001
σ0.003-0.003=-0.000
min0.056-0.056=-0.000
max0.067-0.066=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.712-1756.712=-0.001
σ0.367-0.371=-0.004
min1756.141-1756.137=0.004
max1757.307-1757.306=0.001
mean1634.300-1649.950=-15.650
σ641.435-615.641=25.795
min637.000-642.000=-5.000
max2884.000-2482.000=402.000
mean2.371-2.339=0.032
σ0.147-0.075=0.071
min2.238-2.209=0.029
max2.906-2.512=0.394

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.880-277.881=-0.001
σ0.008-0.006=0.001
min277.868-277.874=-0.006
max277.886-277.891=-0.005
mean2884.000-2482.000=402.000
σ0.000
min2884.000-2482.000=402.000
max2884.000-2482.000=402.000
mean0.406-0.406=0.000
σ0.007-0.007=-0.000
min0.398-0.399=-0.000
max0.413-0.414=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2176.826-2176.830=-0.004
σ0.008-0.012=-0.004
min2176.818-2176.812=0.006
max2176.835-2176.841=-0.006
mean2884.000-2482.000=402.000
σ0.000
min2884.000-2482.000=402.000
max2884.000-2482.000=402.000
mean3.360-3.401=-0.041
σ0.114-0.112=0.002
min3.260-3.276=-0.016
max3.548-3.577=-0.029
iters=5
new-facts=6402
prior-facts=1
mean5054.468-5054.712=-0.244
σ0.732-0.931=-0.199
min5053.871-5054.158=-0.287
max5055.742-5056.371=-0.628
mean2884.000-2482.000=402.000
σ0.000
min2884.000-2482.000=402.000
max2884.000-2482.000=402.000
mean8.944-8.786=0.158
σ0.474-0.543=-0.069
min8.247-8.055=0.192
max9.538-9.317=0.221
iters=5
new-facts=6402
prior-facts=6402
mean5192.049-5192.124=-0.075
σ0.120-0.093=0.027
min5191.874-5192.049=-0.174
max5192.213-5192.226=-0.014
mean3312.400-3253.200=59.200
σ360.306-419.751=-59.446
min2884.000-2675.000=209.000
max3672.000-3645.000=27.000
mean8.810-8.799=0.011
σ0.086-0.132=-0.045
min8.682-8.585=0.097
max8.905-8.944=-0.039

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.948-1.608=-0.660
σ0.013-0.296=-0.283
min0.938-1.110=-0.172
max0.970-1.841=-0.871

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.038-464.028=0.009
σ573.084-573.074=0.009
min177.488-177.488=0.000
max1323.663-1323.640=0.023
mean77.750
σ7.500
min74.000
max89.000
mean2884.000-2482.000=402.000
σ0.000
min2884.000-2482.000=402.000
max2884.000-2482.000=402.000
mean0.440-0.544=-0.104
σ0.302-0.542=-0.240
min0.287-0.264=0.023
max0.893-1.357=-0.464
policies=20
mean1775.188-1775.160=0.029
σ0.347-0.348=-0.001
min1774.958-1774.934=0.024
max1775.702-1775.676=0.026
mean740.000
σ0.000
min740.000
max740.000
mean2884.000-2482.000=402.000
σ0.000
min2884.000-2482.000=402.000
max2884.000-2482.000=402.000
mean2.821-2.746=0.074
σ0.015-0.014=0.001
min2.808-2.733=0.075
max2.840-2.763=0.077
policies=200
mean17758.145-17758.206=-0.061
σ0.436-0.410=0.025
min17757.712-17757.959=-0.247
max17758.750-17758.820=-0.070
mean7400.000
σ0.000
min7400.000
max7400.000
mean2884.000-2482.000=402.000
σ0.000
min2884.000-2482.000=402.000
max2884.000-2482.000=402.000
mean28.128-27.787=0.340
σ0.661-0.152=0.510
min27.479-27.626=-0.147
max28.878-27.966=0.912