Compare commits

Home / Compare b8a1cdf2 .. 1eecfa4e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.374=0.000
σ0.057-0.059=-0.002
min70.341-70.334=0.007
max70.535-70.540=-0.005
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.156-0.158=-0.002
σ0.004-0.006=-0.002
min0.148-0.149=-0.001
max0.163-0.168=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.000
σ0.002-0.002=0.000
min21.139-21.140=-0.001
max21.148-21.146=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.064=0.000
σ0.003-0.003=-0.000
min0.058-0.057=0.001
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.197=0.003
σ0.361-0.362=-0.001
min1751.627-1751.632=-0.005
max1752.795-1752.761=0.033
mean1649.100-1640.800=8.300
σ618.747-613.662=5.086
min673.000-629.000=44.000
max2641.000-2470.000=171.000
mean2.818-2.841=-0.023
σ0.172-0.122=0.050
min2.463-2.603=-0.140
max3.205-3.032=0.173

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.936-269.934=0.002
σ0.007-0.006=0.001
min269.929-269.927=0.002
max269.947-269.943=0.003
mean2641.000-2470.000=171.000
σ0.000
min2641.000-2470.000=171.000
max2641.000-2470.000=171.000
mean0.383-0.382=0.001
σ0.008-0.011=-0.003
min0.371-0.372=-0.001
max0.391-0.400=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.401-1930.386=0.015
σ0.023-0.025=-0.003
min1930.364-1930.357=0.007
max1930.422-1930.411=0.012
mean2641.000-2470.000=171.000
σ0.000
min2641.000-2470.000=171.000
max2641.000-2470.000=171.000
mean2.557-2.566=-0.009
σ0.158-0.161=-0.003
min2.473-2.406=0.068
max2.839-2.830=0.009
iters=5
new-facts=6402
prior-facts=1
mean4750.609-4750.851=-0.242
σ1.103-0.810=0.293
min4749.209-4750.338=-1.129
max4752.284-4752.278=0.006
mean2641.000-2470.000=171.000
σ0.000
min2641.000-2470.000=171.000
max2641.000-2470.000=171.000
mean8.766-8.637=0.129
σ0.292-0.224=0.068
min8.380-8.411=-0.031
max9.055-8.925=0.131
iters=5
new-facts=6402
prior-facts=6402
mean4941.266-4941.332=-0.066
σ0.200-0.084=0.116
min4940.939-4941.259=-0.319
max4941.431-4941.426=0.005
mean2974.000-2961.600=12.400
σ262.865-272.859=-9.994
min2646.000-2595.000=51.000
max3332.000-3316.000=16.000
mean8.518-8.450=0.068
σ0.192-0.032=0.160
min8.298-8.411=-0.114
max8.777-8.495=0.282

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.141-1.850=-0.710
σ0.183-0.033=0.150
min0.933-1.813=-0.880
max1.402-1.885=-0.483

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.903=0.009
σ575.769-575.758=0.010
min178.021-178.022=-0.001
max1329.564-1329.540=0.024
mean81.750
σ7.500
min78.000
max93.000
mean2641.000-2470.000=171.000
σ0.000
min2641.000-2470.000=171.000
max2641.000-2470.000=171.000
mean0.538-0.550=-0.012
σ0.516-0.531=-0.015
min0.278-0.269=0.009
max1.311-1.346=-0.035
policies=20
mean1780.438-1780.452=-0.014
σ0.344-0.356=-0.012
min1780.228-1780.213=0.015
max1780.950-1780.981=-0.030
mean780.000
σ0.000
min780.000
max780.000
mean2641.000-2470.000=171.000
σ0.000
min2641.000-2470.000=171.000
max2641.000-2470.000=171.000
mean2.752-2.767=-0.015
σ0.012-0.015=-0.002
min2.737-2.751=-0.014
max2.763-2.784=-0.021
policies=200
mean17811.420-17811.215=0.205
σ0.573-0.409=0.164
min17811.037-17810.906=0.131
max17812.259-17811.818=0.442
mean7800.000
σ0.000
min7800.000
max7800.000
mean2641.000-2470.000=171.000
σ0.000
min2641.000-2470.000=171.000
max2641.000-2470.000=171.000
mean27.806-27.927=-0.120
σ0.092-0.109=-0.016
min27.715-27.833=-0.118
max27.920-28.051=-0.131