Compare commits

Home / Compare 46c8502f .. 10c722f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.384-70.374=0.010
σ0.047-0.059=-0.012
min70.356-70.334=0.022
max70.517-70.540=-0.023
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.158=0.001
σ0.003-0.006=-0.003
min0.155-0.149=0.006
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.002-0.002=0.000
min21.137-21.140=-0.003
max21.146-21.146=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.064=0.001
σ0.002-0.003=-0.001
min0.063-0.057=0.006
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.197=0.197
σ0.360-0.362=-0.002
min1751.824-1751.632=0.193
max1752.975-1752.761=0.213
mean1654.400-1640.800=13.600
σ627.581-613.662=13.919
min618.000-629.000=-11.000
max2769.000-2470.000=299.000
mean2.806-2.841=-0.036
σ0.190-0.122=0.068
min2.322-2.603=-0.281
max2.981-3.032=-0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.139-269.934=0.206
σ0.009-0.006=0.003
min270.131-269.927=0.204
max270.154-269.943=0.210
mean2769.000-2470.000=299.000
σ0.000
min2769.000-2470.000=299.000
max2769.000-2470.000=299.000
mean0.377-0.382=-0.005
σ0.004-0.011=-0.007
min0.371-0.372=-0.001
max0.382-0.400=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1930.386=0.221
σ0.007-0.025=-0.018
min1930.596-1930.357=0.239
max1930.615-1930.411=0.204
mean2769.000-2470.000=299.000
σ0.000
min2769.000-2470.000=299.000
max2769.000-2470.000=299.000
mean2.512-2.566=-0.054
σ0.085-0.161=-0.076
min2.431-2.406=0.025
max2.654-2.830=-0.177
iters=5
new-facts=6402
prior-facts=1
mean4751.332-4750.851=0.482
σ0.888-0.810=0.079
min4750.819-4750.338=0.481
max4752.914-4752.278=0.636
mean2769.000-2470.000=299.000
σ0.000
min2769.000-2470.000=299.000
max2769.000-2470.000=299.000
mean8.413-8.637=-0.225
σ0.465-0.224=0.241
min7.741-8.411=-0.670
max8.979-8.925=0.055
iters=5
new-facts=6402
prior-facts=6402
mean4941.699-4941.332=0.367
σ0.144-0.084=0.060
min4941.443-4941.259=0.184
max4941.790-4941.426=0.364
mean3044.400-2961.600=82.800
σ235.302-272.859=-37.557
min2769.000-2595.000=174.000
max3371.000-3316.000=55.000
mean8.680-8.450=0.230
σ0.208-0.032=0.176
min8.394-8.411=-0.018
max8.925-8.495=0.429

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.019-1.850=-0.831
σ0.117-0.033=0.084
min0.940-1.813=-0.873
max1.209-1.885=-0.676

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.371-465.903=0.468
σ575.930-575.758=0.172
min178.400-178.022=0.378
max1330.266-1329.540=0.725
mean84.250-81.750=2.500
σ8.500-7.500=1.000
min80.000-78.000=2.000
max97.000-93.000=4.000
mean2769.000-2470.000=299.000
σ0.000
min2769.000-2470.000=299.000
max2769.000-2470.000=299.000
mean0.448-0.550=-0.101
σ0.304-0.531=-0.227
min0.293-0.269=0.024
max0.904-1.346=-0.442
policies=20
mean1784.336-1780.452=3.883
σ0.336-0.356=-0.020
min1784.101-1780.213=3.888
max1784.823-1780.981=3.842
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2769.000-2470.000=299.000
σ0.000
min2769.000-2470.000=299.000
max2769.000-2470.000=299.000
mean2.847-2.767=0.080
σ0.128-0.015=0.114
min2.780-2.751=0.029
max3.040-2.784=0.256
policies=200
mean17849.503-17811.215=38.288
σ0.490-0.409=0.081
min17849.216-17810.906=38.310
max17850.235-17811.818=38.418
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2769.000-2470.000=299.000
σ0.000
min2769.000-2470.000=299.000
max2769.000-2470.000=299.000
mean28.008-27.927=0.081
σ0.113-0.109=0.005
min27.882-27.833=0.049
max28.156-28.051=0.104