Compare commits

Home / Compare ff4ada7c .. 8bf5f2c9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.372=0.002
σ0.060-0.059=0.001
min70.330-70.338=-0.008
max70.541-70.537=0.004
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.158-0.155=0.003
σ0.005-0.007=-0.002
min0.151-0.148=0.003
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.001-0.002=-0.001
min21.143-21.140=0.003
max21.147-21.148=-0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.064-0.062=0.002
σ0.003-0.003=-0.000
min0.062-0.057=0.005
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.201=-0.000
σ0.361-0.362=-0.001
min1751.634-1751.630=0.004
max1752.791-1752.791=0.000
mean1659.800-1655.300=4.500
σ623.905-641.913=-18.008
min671.000-620.000=51.000
max2511.000-2775.000=-264.000
mean2.809-2.799=0.009
σ0.179-0.193=-0.015
min2.396-2.334=0.063
max3.073-3.143=-0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.929-269.907=0.022
σ0.006-0.008=-0.002
min269.921-269.895=0.027
max269.937-269.915=0.023
mean2511.000-2775.000=-264.000
σ0.000
min2511.000-2775.000=-264.000
max2511.000-2775.000=-264.000
mean0.374-0.374=-0.000
σ0.002-0.004=-0.002
min0.372-0.370=0.002
max0.378-0.381=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1790.181-1930.399=-140.218
σ313.539-0.014=313.525
min1229.306-1930.384=-701.078
max1930.406-1930.418=-0.012
mean2511.000-2775.000=-264.000
σ0.000
min2511.000-2775.000=-264.000
max2511.000-2775.000=-264.000
mean2.442-2.557=-0.115
σ0.419-0.197=0.221
min1.755-2.395=-0.640
max2.854-2.859=-0.005
iters=5
new-facts=6402
prior-facts=1
mean4750.811-4750.856=-0.045
σ0.890-0.819=0.071
min4750.334-4750.334=-0.000
max4752.398-4752.311=0.087
mean2511.000-2775.000=-264.000
σ0.000
min2511.000-2775.000=-264.000
max2511.000-2775.000=-264.000
mean8.895-8.505=0.389
σ0.173-0.528=-0.355
min8.613-7.617=0.996
max9.084-8.921=0.163
iters=5
new-facts=6402
prior-facts=6402
mean4941.334-4941.260=0.074
σ0.086-0.201=-0.115
min4941.261-4940.932=0.329
max4941.439-4941.426=0.013
mean2965.600-3045.800=-80.200
σ336.390-208.752=127.639
min2522.000-2775.000=-253.000
max3279.000-3324.000=-45.000
mean8.740-8.602=0.137
σ0.459-0.208=0.250
min8.384-8.362=0.022
max9.544-8.912=0.632

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.750-1.064=0.685
σ0.240-0.170=0.070
min1.413-0.923=0.490
max1.933-1.345=0.588

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.933-465.942=-0.010
σ575.816-575.815=0.002
min178.021-178.030=-0.009
max1329.657-1329.664=-0.007
mean81.750
σ7.500
min78.000
max93.000
mean2511.000-2775.000=-264.000
σ0.000
min2511.000-2775.000=-264.000
max2511.000-2775.000=-264.000
mean0.551-0.444=0.108
σ0.541-0.307=0.234
min0.276-0.289=-0.013
max1.363-0.904=0.459
policies=20
mean1780.448-1780.498=-0.050
σ0.308-0.334=-0.026
min1780.238-1780.260=-0.022
max1780.903-1780.988=-0.085
mean780.000
σ0.000
min780.000
max780.000
mean2511.000-2775.000=-264.000
σ0.000
min2511.000-2775.000=-264.000
max2511.000-2775.000=-264.000
mean2.645-2.849=-0.204
σ0.204-0.145=0.059
min2.344-2.741=-0.397
max2.785-3.057=-0.272
policies=200
mean17811.579-17811.515=0.064
σ0.466-0.437=0.029
min17811.314-17811.149=0.166
max17812.276-17812.149=0.127
mean7800.000
σ0.000
min7800.000
max7800.000
mean2511.000-2775.000=-264.000
σ0.000
min2511.000-2775.000=-264.000
max2511.000-2775.000=-264.000
mean27.840-27.938=-0.097
σ0.140-0.146=-0.006
min27.695-27.778=-0.082
max28.022-28.117=-0.096