Compare commits

Home / Compare 14a4d6fc .. 19c0dd2e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-70.706=2.340
σ0.046-0.045=0.001
min73.022-70.676=2.346
max73.176-70.832=2.344
mean414.000
σ0.000
min414.000
max414.000
mean0.161-0.176=-0.015
σ0.003-0.009=-0.006
min0.158-0.158=0.000
max0.167-0.185=-0.018
cache=y
dps=1
iters=10
policies=100
mean23.740-21.409=2.330
σ0.002-0.003=-0.001
min23.736-21.404=2.332
max23.743-21.413=2.329
mean414.000
σ0.000
min414.000
max414.000
mean0.066-0.066=-0.000
σ0.003-0.002=0.001
min0.064-0.064=0.000
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1754.932=3.856
σ0.362-0.361=0.001
min1758.210-1754.357=3.853
max1759.372-1755.518=3.854
mean1654.550-1647.050=7.500
σ620.191-632.385=-12.194
min624.000-622.000=2.000
max2502.000-2769.000=-267.000
mean2.815-2.911=-0.095
σ0.191-0.148=0.043
min2.084-2.778=-0.694
max3.010-3.360=-0.350

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.022-272.792=51.229
σ0.032-0.006=0.026
min323.968-272.784=51.183
max324.048-272.798=51.250
mean2502.000-2769.000=-267.000
σ0.000
min2502.000-2769.000=-267.000
max2502.000-2769.000=-267.000
mean0.430-0.381=0.048
σ0.007-0.005=0.002
min0.424-0.377=0.047
max0.439-0.390=0.049
iters=5
new-facts=1
prior-facts=6402
mean1984.587-1933.226=51.361
σ0.021-0.007=0.014
min1984.551-1933.214=51.337
max1984.605-1933.233=51.373
mean2502.000-2769.000=-267.000
σ0.000
min2502.000-2769.000=-267.000
max2502.000-2769.000=-267.000
mean2.592-3.019=-0.427
σ0.109-0.129=-0.019
min2.446-2.842=-0.395
max2.716-3.204=-0.489
iters=5
new-facts=6402
prior-facts=1
mean4807.985-4756.860=51.125
σ7.952-7.669=0.283
min4804.163-4752.954=51.209
max4822.202-4770.569=51.633
mean2502.000-2769.000=-267.000
σ0.000
min2502.000-2769.000=-267.000
max2502.000-2769.000=-267.000
mean8.831-8.378=0.453
σ0.140-0.556=-0.415
min8.663-7.771=0.891
max9.031-8.925=0.107
iters=5
new-facts=6402
prior-facts=6402
mean4995.805-4944.455=51.350
σ0.025-0.014=0.011
min4995.773-4944.442=51.332
max4995.834-4944.473=51.360
mean3012.000-3002.400=9.600
σ303.720-298.001=5.719
min2600.000-2769.000=-169.000
max3394.000-3471.000=-77.000
mean8.605-8.382=0.223
σ0.077-0.039=0.039
min8.499-8.355=0.144
max8.687-8.445=0.242

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.641-1.031=0.610
σ0.177-0.132=0.045
min1.375-0.912=0.462
max1.837-1.234=0.603

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.329-468.322=0.007
σ574.232-574.228=0.004
min181.211-181.204=0.007
max1329.677-1329.664=0.013
mean88.250
σ8.500
min84.000
max101.000
mean2502.000-2769.000=-267.000
σ0.000
min2502.000-2769.000=-267.000
max2502.000-2769.000=-267.000
mean0.559-0.442=0.117
σ0.547-0.304=0.244
min0.280-0.288=-0.007
max1.380-0.898=0.482
policies=20
mean1812.427-1812.352=0.076
σ0.385-0.394=-0.009
min1812.178-1812.071=0.106
max1812.999-1812.929=0.071
mean840.000
σ0.000
min840.000
max840.000
mean2502.000-2769.000=-267.000
σ0.000
min2502.000-2769.000=-267.000
max2502.000-2769.000=-267.000
mean2.809-2.899=-0.090
σ0.008-0.019=-0.011
min2.798-2.884=-0.086
max2.817-2.926=-0.109
policies=200
mean18131.470-18128.942=2.529
σ0.562-0.376=0.186
min18131.113-18128.544=2.569
max18132.306-18129.440=2.867
mean8400.000
σ0.000
min8400.000
max8400.000
mean2502.000-2769.000=-267.000
σ0.000
min2502.000-2769.000=-267.000
max2502.000-2769.000=-267.000
mean28.269-28.487=-0.218
σ0.071-0.103=-0.031
min28.186-28.406=-0.220
max28.355-28.634=-0.279