Compare commits

Home / Compare 8aba8a36 .. a4cdfb88

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-70.374=0.002
σ0.057-0.057=-0.000
min70.340-70.335=0.005
max70.537-70.533=0.004
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.160-0.161=-0.001
σ0.005-0.003=0.002
min0.151-0.158=-0.007
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.001
σ0.002-0.002=0.000
min21.141-21.139=0.001
max21.147-21.145=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.064-0.064=-0.001
σ0.003-0.002=0.000
min0.059-0.062=-0.004
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.201=-0.001
σ0.361-0.362=-0.002
min1751.632-1751.629=0.003
max1752.786-1752.791=-0.005
mean1650.550-1659.500=-8.950
σ641.319-626.191=15.127
min633.000-682.000=-49.000
max2857.000-2745.000=112.000
mean2.811-2.817=-0.006
σ0.112-0.088=0.024
min2.572-2.658=-0.086
max2.976-2.997=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.933-269.930=0.003
σ0.009-0.006=0.003
min269.920-269.927=-0.007
max269.944-269.941=0.003
mean2857.000-2745.000=112.000
σ0.000
min2857.000-2745.000=112.000
max2857.000-2745.000=112.000
mean0.375-0.374=0.001
σ0.008-0.004=0.004
min0.369-0.371=-0.002
max0.386-0.381=0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.398-1930.389=0.009
σ0.018-0.014=0.004
min1930.367-1930.374=-0.007
max1930.408-1930.407=0.001
mean2857.000-2745.000=112.000
σ0.000
min2857.000-2745.000=112.000
max2857.000-2745.000=112.000
mean2.490-2.613=-0.123
σ0.060-0.094=-0.034
min2.446-2.445=0.001
max2.592-2.665=-0.073
iters=5
new-facts=6402
prior-facts=1
mean4750.733-4750.859=-0.126
σ0.889-0.886=0.003
min4750.020-4750.325=-0.305
max4752.266-4752.436=-0.170
mean2857.000-2745.000=112.000
σ0.000
min2857.000-2745.000=112.000
max2857.000-2745.000=112.000
mean8.610-8.674=-0.064
σ0.294-0.594=-0.300
min8.322-7.808=0.514
max9.061-9.215=-0.154
iters=5
new-facts=6402
prior-facts=6402
mean4941.322-4941.264=0.058
σ0.097-0.210=-0.113
min4941.239-4940.925=0.314
max4941.431-4941.448=-0.017
mean3057.400-3067.000=-9.600
σ202.554-308.680=-106.126
min2857.000-2745.000=112.000
max3333.000-3372.000=-39.000
mean8.564-8.743=-0.178
σ0.229-0.431=-0.203
min8.340-8.284=0.056
max8.825-9.399=-0.574

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.989-1.138=-0.148
σ0.137-0.245=-0.109
min0.915-0.933=-0.018
max1.233-1.564=-0.331

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.918=-0.006
σ575.765-575.771=-0.006
min178.024-178.027=-0.003
max1329.558-1329.574=-0.016
mean81.750
σ7.500
min78.000
max93.000
mean2857.000-2745.000=112.000
σ0.000
min2857.000-2745.000=112.000
max2857.000-2745.000=112.000
mean0.440-0.532=-0.092
σ0.304-0.504=-0.200
min0.286-0.278=0.008
max0.897-1.288=-0.391
policies=20
mean1780.507-1780.483=0.024
σ0.352-0.357=-0.005
min1780.261-1780.237=0.024
max1781.024-1781.012=0.012
mean780.000
σ0.000
min780.000
max780.000
mean2857.000-2745.000=112.000
σ0.000
min2857.000-2745.000=112.000
max2857.000-2745.000=112.000
mean2.853-2.779=0.075
σ0.007-0.005=0.003
min2.845-2.773=0.072
max2.862-2.784=0.078
policies=200
mean17811.476-17811.408=0.068
σ0.445-0.578=-0.133
min17811.064-17811.096=-0.032
max17812.101-17812.274=-0.173
mean7800.000
σ0.000
min7800.000
max7800.000
mean2857.000-2745.000=112.000
σ0.000
min2857.000-2745.000=112.000
max2857.000-2745.000=112.000
mean28.363-27.990=0.373
σ0.490-0.075=0.414
min27.838-27.936=-0.098
max28.814-28.101=0.713