Compare commits

Home / Compare 83c85b1b .. 358478e8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.374=0.000
σ0.059-0.059=-0.001
min70.333-70.334=-0.000
max70.538-70.540=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.159-0.158=0.002
σ0.003-0.006=-0.003
min0.155-0.149=0.006
max0.164-0.168=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.002=0.000
min21.139-21.140=-0.002
max21.146-21.146=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.062-0.064=-0.002
σ0.003-0.003=0.000
min0.058-0.057=0.001
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.197=0.003
σ0.362-0.362=0.000
min1751.629-1751.632=-0.003
max1752.783-1752.761=0.022
mean1652.850-1640.800=12.050
σ645.010-613.662=31.349
min647.000-629.000=18.000
max2846.000-2470.000=376.000
mean2.766-2.841=-0.075
σ0.204-0.122=0.082
min2.292-2.603=-0.311
max3.139-3.032=0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.931-269.934=-0.002
σ0.010-0.006=0.004
min269.919-269.927=-0.008
max269.945-269.943=0.002
mean2846.000-2470.000=376.000
σ0.000
min2846.000-2470.000=376.000
max2846.000-2470.000=376.000
mean0.374-0.382=-0.008
σ0.007-0.011=-0.004
min0.368-0.372=-0.004
max0.386-0.400=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1930.401-1930.386=0.015
σ0.004-0.025=-0.021
min1930.396-1930.357=0.039
max1930.407-1930.411=-0.004
mean2846.000-2470.000=376.000
σ0.000
min2846.000-2470.000=376.000
max2846.000-2470.000=376.000
mean2.565-2.566=-0.001
σ0.089-0.161=-0.072
min2.471-2.406=0.065
max2.666-2.830=-0.164
iters=5
new-facts=6402
prior-facts=1
mean4750.633-4750.851=-0.217
σ1.078-0.810=0.269
min4749.751-4750.338=-0.587
max4752.460-4752.278=0.182
mean2846.000-2470.000=376.000
σ0.000
min2846.000-2470.000=376.000
max2846.000-2470.000=376.000
mean8.686-8.637=0.049
σ0.622-0.224=0.398
min7.605-8.411=-0.806
max9.132-8.925=0.207
iters=5
new-facts=6402
prior-facts=6402
mean4941.336-4941.332=0.004
σ0.078-0.084=-0.005
min4941.271-4941.259=0.012
max4941.431-4941.426=0.005
mean3101.600-2961.600=140.000
σ259.112-272.859=-13.747
min2846.000-2595.000=251.000
max3364.000-3316.000=48.000
mean8.744-8.450=0.294
σ0.240-0.032=0.208
min8.436-8.411=0.025
max8.972-8.495=0.477

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.850=-0.823
σ0.139-0.033=0.105
min0.933-1.813=-0.880
max1.257-1.885=-0.628

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.914-465.903=0.011
σ575.755-575.758=-0.003
min178.029-178.022=0.007
max1329.547-1329.540=0.007
mean81.750
σ7.500
min78.000
max93.000
mean2846.000-2470.000=376.000
σ0.000
min2846.000-2470.000=376.000
max2846.000-2470.000=376.000
mean0.440-0.550=-0.110
σ0.307-0.531=-0.224
min0.283-0.269=0.015
max0.899-1.346=-0.447
policies=20
mean1780.509-1780.452=0.057
σ0.348-0.356=-0.008
min1780.271-1780.213=0.058
max1781.024-1780.981=0.043
mean780.000
σ0.000
min780.000
max780.000
mean2846.000-2470.000=376.000
σ0.000
min2846.000-2470.000=376.000
max2846.000-2470.000=376.000
mean2.826-2.767=0.059
σ0.040-0.015=0.026
min2.768-2.751=0.017
max2.857-2.784=0.073
policies=200
mean17811.460-17811.215=0.245
σ0.557-0.409=0.148
min17810.976-17810.906=0.070
max17812.245-17811.818=0.427
mean7800.000
σ0.000
min7800.000
max7800.000
mean2846.000-2470.000=376.000
σ0.000
min2846.000-2470.000=376.000
max2846.000-2470.000=376.000
mean28.377-27.927=0.450
σ0.532-0.109=0.423
min27.790-27.833=-0.044
max28.988-28.051=0.937