Compare commits

Home / Compare 37f26b55 .. 792299d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.648=-0.000
σ0.367-0.367=0.000
min53.521-53.522=-0.000
max54.693-54.693=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.140-0.138=0.002
σ0.005-0.004=0.001
min0.135-0.133=0.002
max0.148-0.144=0.004
cache=y
dps=1
iters=10
policies=100
mean42.943-42.942=0.001
σ0.005-0.006=-0.001
min42.936-42.933=0.003
max42.953-42.951=0.002
mean414.000-414.700=-0.700
σ0.000-0.483=-0.483
min414.000
max414.000-415.000=-1.000
mean0.125-0.122=0.003
σ0.006-0.003=0.003
min0.120-0.120=0.000
max0.139-0.129=0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.863-991.863=-0.000
σ1.229-1.211=0.018
min991.267-991.269=-0.002
max997.003-996.916=0.087
mean1054.600-1065.100=-10.500
σ313.441-324.062=-10.620
min580.000-578.000=2.000
max1481.000-1644.000=-163.000
mean1.548-1.543=0.005
σ0.088-0.155=-0.067
min1.451-1.451=0.000
max1.762-2.153=-0.391

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.440-285.441=-0.001
σ0.014-0.012=0.002
min285.416-285.421=-0.005
max285.451-285.454=-0.004
mean1481.000-1644.000=-163.000
σ0.000
min1481.000-1644.000=-163.000
max1481.000-1644.000=-163.000
mean0.383-0.380=0.003
σ0.009-0.005=0.004
min0.375-0.377=-0.003
max0.393-0.389=0.004
iters=5
new-facts=1
prior-facts=6402
mean1285.498-1285.519=-0.021
σ0.084-0.082=0.002
min1285.354-1285.381=-0.027
max1285.560-1285.591=-0.031
mean1481.000-1644.000=-163.000
σ0.000
min1481.000-1644.000=-163.000
max1481.000-1644.000=-163.000
mean1.919-2.003=-0.083
σ0.051-0.263=-0.212
min1.843-1.866=-0.023
max1.980-2.473=-0.494
iters=5
new-facts=6402
prior-facts=1
mean1705.836-1705.825=0.012
σ6.869-6.856=0.013
min1702.652-1702.637=0.015
max1718.122-1718.086=0.036
mean1481.000-1644.000=-163.000
σ0.000
min1481.000-1644.000=-163.000
max1481.000-1644.000=-163.000
mean3.023-2.938=0.085
σ0.219-0.198=0.021
min2.854-2.722=0.132
max3.360-3.263=0.097
iters=5
new-facts=6402
prior-facts=6402
mean1968.413-1968.431=-0.018
σ0.026-0.003=0.023
min1968.385-1968.427=-0.041
max1968.444-1968.435=0.009
mean1790.000-1764.400=25.600
σ188.845-131.268=57.577
min1541.000-1644.000=-103.000
max2024.000-1946.000=78.000
mean3.198-3.100=0.097
σ0.215-0.139=0.077
min3.069-2.966=0.103
max3.581-3.329=0.251

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.535-1.279=0.256
σ0.134-0.386=-0.252
min1.375-0.910=0.465
max1.661-1.869=-0.209

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.686-436.697=-0.011
σ572.356-572.360=-0.004
min150.504-150.509=-0.005
max1295.219-1295.236=-0.017
mean90.250
σ8.500
min86.000
max103.000
mean1481.000-1644.000=-163.000
σ0.000
min1481.000-1644.000=-163.000
max1481.000-1644.000=-163.000
mean0.526-0.524=0.002
σ0.545-0.537=0.008
min0.248-0.251=-0.003
max1.344-1.330=0.014
policies=20
mean1505.353-1505.360=-0.007
σ0.229-0.243=-0.014
min1505.197-1505.199=-0.002
max1505.694-1505.722=-0.029
mean860.000
σ0.000
min860.000
max860.000
mean1481.000-1644.000=-163.000
σ0.000
min1481.000-1644.000=-163.000
max1481.000-1644.000=-163.000
mean2.511-2.524=-0.013
σ0.017-0.016=0.002
min2.491-2.507=-0.016
max2.533-2.538=-0.005
policies=200
mean15061.165-15061.159=0.007
σ0.094-0.109=-0.015
min15061.045-15061.043=0.003
max15061.273-15061.293=-0.020
mean8600.000
σ0.000
min8600.000
max8600.000
mean1481.000-1644.000=-163.000
σ0.000
min1481.000-1644.000=-163.000
max1481.000-1644.000=-163.000
mean25.555-25.506=0.049
σ0.181-0.215=-0.034
min25.375-25.298=0.077
max25.741-25.784=-0.042