Compare commits

Home / Compare e493a426 .. 5e3899c0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.731-70.729=0.002
σ0.050-0.052=-0.002
min70.704-70.698=0.006
max70.871-70.873=-0.002
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.162-0.158=0.004
σ0.005-0.005=-0.000
min0.154-0.155=-0.001
max0.173-0.169=0.004
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=0.000
σ0.002-0.003=-0.001
min21.443-21.442=0.000
max21.448-21.452=-0.004
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.067-0.065=0.001
σ0.003-0.002=0.001
min0.065-0.064=0.001
max0.074-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.285-1755.285=0.001
σ0.359-0.361=-0.002
min1754.717-1754.719=-0.002
max1755.865-1755.864=0.000
mean1625.350-1653.000=-27.650
σ595.382-626.259=-30.877
min636.000-620.000=16.000
max2420.000-2728.000=-308.000
mean2.836-2.782=0.054
σ0.191-0.200=-0.010
min2.183-2.195=-0.013
max3.075-2.990=0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.766-272.768=-0.002
σ0.004-0.006=-0.003
min272.760-272.758=0.002
max272.768-272.774=-0.006
mean2420.000-2728.000=-308.000
σ0.000
min2420.000-2728.000=-308.000
max2420.000-2728.000=-308.000
mean0.384-0.385=-0.001
σ0.004-0.004=-0.000
min0.379-0.381=-0.002
max0.390-0.391=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.150-1933.165=-0.015
σ0.017-0.012=0.005
min1933.128-1933.147=-0.019
max1933.175-1933.176=-0.001
mean2420.000-2728.000=-308.000
σ0.000
min2420.000-2728.000=-308.000
max2420.000-2728.000=-308.000
mean3.148-3.051=0.097
σ0.150-0.070=0.080
min3.011-2.971=0.040
max3.379-3.154=0.225
iters=5
new-facts=6402
prior-facts=1
mean4753.770-4753.444=0.326
σ0.939-1.155=-0.216
min4752.884-4752.481=0.403
max4755.370-4755.411=-0.041
mean2420.000-2728.000=-308.000
σ0.000
min2420.000-2728.000=-308.000
max2420.000-2728.000=-308.000
mean8.545-8.529=0.016
σ0.463-0.485=-0.022
min7.866-7.841=0.025
max9.003-9.097=-0.093
iters=5
new-facts=6402
prior-facts=6402
mean4944.313-4944.312=0.001
σ0.161-0.144=0.017
min4944.025-4944.056=-0.031
max4944.403-4944.405=-0.003
mean2905.200-2985.400=-80.200
σ408.825-307.288=101.538
min2434.000-2728.000=-294.000
max3461.000-3434.000=27.000
mean8.451-8.350=0.102
σ0.149-0.071=0.079
min8.345-8.244=0.101
max8.714-8.440=0.274

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.752-1.092=0.660
σ0.020-0.181=-0.161
min1.725-0.916=0.809
max1.774-1.312=0.462

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.829-472.844=-0.015
σ574.922-574.940=-0.018
min185.365-185.365=-0.001
max1335.212-1335.254=-0.042
mean88.250
σ8.500
min84.000
max101.000
mean2420.000-2728.000=-308.000
σ0.000
min2420.000-2728.000=-308.000
max2420.000-2728.000=-308.000
mean0.563-0.559=0.004
σ0.523-0.547=-0.024
min0.296-0.284=0.012
max1.348-1.380=-0.033
policies=20
mean1853.939-1853.989=-0.050
σ0.372-0.379=-0.007
min1853.673-1853.728=-0.055
max1854.486-1854.549=-0.063
mean840.000
σ0.000
min840.000
max840.000
mean2420.000-2728.000=-308.000
σ0.000
min2420.000-2728.000=-308.000
max2420.000-2728.000=-308.000
mean2.864-2.874=-0.010
σ0.025-0.029=-0.003
min2.827-2.842=-0.015
max2.883-2.905=-0.022
policies=200
mean18546.113-18546.705=-0.592
σ0.920-0.395=0.525
min18545.361-18546.416=-1.055
max18547.270-18547.289=-0.020
mean8400.000
σ0.000
min8400.000
max8400.000
mean2420.000-2728.000=-308.000
σ0.000
min2420.000-2728.000=-308.000
max2420.000-2728.000=-308.000
mean28.954-28.866=0.088
σ0.108-0.152=-0.043
min28.841-28.742=0.099
max29.101-29.079=0.022