Compare commits

Home / Compare 582a5c57 .. a1e5b9f2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.374=0.001
σ0.058-0.059=-0.001
min70.335-70.334=0.001
max70.537-70.540=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.157-0.158=-0.001
σ0.004-0.006=-0.002
min0.150-0.149=0.001
max0.163-0.168=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.002=0.000
min21.139-21.140=-0.001
max21.147-21.146=0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.062-0.064=-0.002
σ0.003-0.003=0.000
min0.057-0.057=0.000
max0.065-0.069=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.203-1752.197=0.005
σ0.361-0.362=-0.001
min1751.625-1751.632=-0.006
max1752.784-1752.761=0.023
mean1655.900-1640.800=15.100
σ646.775-613.662=33.113
min647.000-629.000=18.000
max2858.000-2470.000=388.000
mean2.864-2.841=0.023
σ0.108-0.122=-0.014
min2.562-2.603=-0.041
max3.091-3.032=0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.934=-0.002
σ0.007-0.006=0.001
min269.920-269.927=-0.007
max269.938-269.943=-0.005
mean2858.000-2470.000=388.000
σ0.000
min2858.000-2470.000=388.000
max2858.000-2470.000=388.000
mean0.372-0.382=-0.010
σ0.006-0.011=-0.005
min0.368-0.372=-0.004
max0.382-0.400=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1930.400-1930.386=0.014
σ0.025-0.025=-0.001
min1930.357-1930.357=0.000
max1930.420-1930.411=0.009
mean2858.000-2470.000=388.000
σ0.000
min2858.000-2470.000=388.000
max2858.000-2470.000=388.000
mean2.537-2.566=-0.029
σ0.132-0.161=-0.029
min2.444-2.406=0.039
max2.755-2.830=-0.076
iters=5
new-facts=6402
prior-facts=1
mean4750.845-4750.851=-0.005
σ0.803-0.810=-0.006
min4750.343-4750.338=0.006
max4752.259-4752.278=-0.020
mean2858.000-2470.000=388.000
σ0.000
min2858.000-2470.000=388.000
max2858.000-2470.000=388.000
mean8.593-8.637=-0.045
σ0.275-0.224=0.050
min8.281-8.411=-0.130
max8.919-8.925=-0.006
iters=5
new-facts=6402
prior-facts=6402
mean4941.329-4941.332=-0.003
σ0.083-0.084=-0.000
min4941.263-4941.259=0.004
max4941.421-4941.426=-0.005
mean3022.400-2961.600=60.800
σ186.934-272.859=-85.925
min2858.000-2595.000=263.000
max3314.000-3316.000=-2.000
mean8.453-8.450=0.003
σ0.120-0.032=0.088
min8.294-8.411=-0.117
max8.556-8.495=0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.054-1.850=-0.797
σ0.126-0.033=0.093
min0.938-1.813=-0.875
max1.251-1.885=-0.634

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.913-465.903=0.010
σ575.757-575.758=-0.001
min178.031-178.022=0.009
max1329.548-1329.540=0.008
mean81.750
σ7.500
min78.000
max93.000
mean2858.000-2470.000=388.000
σ0.000
min2858.000-2470.000=388.000
max2858.000-2470.000=388.000
mean0.442-0.550=-0.108
σ0.303-0.531=-0.228
min0.286-0.269=0.017
max0.897-1.346=-0.449
policies=20
mean1780.506-1780.452=0.053
σ0.357-0.356=0.001
min1780.252-1780.213=0.039
max1781.030-1780.981=0.049
mean780.000
σ0.000
min780.000
max780.000
mean2858.000-2470.000=388.000
σ0.000
min2858.000-2470.000=388.000
max2858.000-2470.000=388.000
mean2.849-2.767=0.082
σ0.009-0.015=-0.006
min2.841-2.751=0.090
max2.861-2.784=0.077
policies=200
mean17811.595-17811.215=0.380
σ0.462-0.409=0.053
min17811.256-17810.906=0.350
max17812.278-17811.818=0.460
mean7800.000
σ0.000
min7800.000
max7800.000
mean2858.000-2470.000=388.000
σ0.000
min2858.000-2470.000=388.000
max2858.000-2470.000=388.000
mean28.364-27.927=0.437
σ0.466-0.109=0.357
min27.819-27.833=-0.015
max28.792-28.051=0.741