Compare commits

Home / Compare fc4ae16f .. e11369a6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.567=-0.001
σ0.045-0.045=-0.000
min70.540-70.541=-0.001
max70.689-70.690=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.161-0.160=0.002
σ0.004-0.003=0.000
min0.157-0.154=0.003
max0.167-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.001
σ0.003-0.003=-0.000
min21.283-21.285=-0.002
max21.291-21.292=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.065=0.000
σ0.003-0.002=0.000
min0.063-0.063=0.000
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.567-1753.568=-0.001
σ0.360-0.361=-0.000
min1752.991-1752.997=-0.006
max1754.150-1754.152=-0.002
mean1646.900-1658.550=-11.650
σ639.231-647.667=-8.436
min628.000-627.000=1.000
max2876.000-2908.000=-32.000
mean2.810-2.759=0.051
σ0.156-0.166=-0.010
min2.418-2.371=0.047
max3.030-3.009=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.017-272.018=-0.002
σ0.008-0.005=0.004
min272.009-272.013=-0.004
max272.030-272.025=0.004
mean2876.000-2908.000=-32.000
σ0.000
min2876.000-2908.000=-32.000
max2876.000-2908.000=-32.000
mean0.391-0.388=0.004
σ0.009-0.010=-0.000
min0.379-0.378=0.001
max0.402-0.400=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.439-1932.437=0.003
σ0.011-0.010=0.001
min1932.421-1932.421=0.001
max1932.450-1932.446=0.004
mean2876.000-2908.000=-32.000
σ0.000
min2876.000-2908.000=-32.000
max2876.000-2908.000=-32.000
mean2.944-3.000=-0.056
σ0.140-0.078=0.061
min2.796-2.938=-0.141
max3.121-3.135=-0.014
iters=5
new-facts=6402
prior-facts=1
mean4753.192-4753.054=0.138
σ0.804-0.955=-0.151
min4752.749-4752.087=0.662
max4754.626-4754.653=-0.027
mean2876.000-2908.000=-32.000
σ0.000
min2876.000-2908.000=-32.000
max2876.000-2908.000=-32.000
mean8.375-8.499=-0.124
σ0.412-0.587=-0.176
min7.716-7.607=0.109
max8.728-9.121=-0.393
iters=5
new-facts=6402
prior-facts=6402
mean4943.565-4943.417=0.148
σ0.167-0.309=-0.142
min4943.267-4942.938=0.329
max4943.659-4943.662=-0.004
mean3055.000-3099.600=-44.600
σ188.258-212.359=-24.101
min2876.000-2908.000=-32.000
max3327.000-3424.000=-97.000
mean8.791-8.617=0.174
σ0.382-0.223=0.159
min8.452-8.394=0.058
max9.367-8.951=0.417

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-1.085=-0.054
σ0.140-0.178=-0.038
min0.940-0.912=0.028
max1.260-1.288=-0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.076-473.085=-0.009
σ575.916-575.921=-0.005
min185.109-185.115=-0.006
max1336.950-1336.966=-0.017
mean88.250
σ8.500
min84.000
max101.000
mean2876.000-2908.000=-32.000
σ0.000
min2876.000-2908.000=-32.000
max2876.000-2908.000=-32.000
mean0.487-0.451=0.036
σ0.381-0.303=0.078
min0.277-0.298=-0.021
max1.058-0.906=0.152
policies=20
mean1851.428-1851.468=-0.040
σ0.374-0.378=-0.004
min1851.141-1851.190=-0.049
max1851.970-1852.019=-0.049
mean840.000
σ0.000
min840.000
max840.000
mean2876.000-2908.000=-32.000
σ0.000
min2876.000-2908.000=-32.000
max2876.000-2908.000=-32.000
mean2.972-2.943=0.029
σ0.021-0.002=0.019
min2.948-2.941=0.008
max2.994-2.945=0.048
policies=200
mean18520.893-18521.128=-0.235
σ0.465-0.521=-0.057
min18520.631-18520.716=-0.085
max18521.587-18521.891=-0.304
mean8400.000
σ0.000
min8400.000
max8400.000
mean2876.000-2908.000=-32.000
σ0.000
min2876.000-2908.000=-32.000
max2876.000-2908.000=-32.000
mean29.236-29.231=0.005
σ0.397-0.510=-0.113
min28.777-28.759=0.018
max29.745-29.749=-0.005