Compare commits

Home / Compare e21f4a33 .. f8701904

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.730=0.000
σ0.045-0.048=-0.003
min70.708-70.702=0.006
max70.857-70.865=-0.009
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.160-0.159=0.000
σ0.003-0.003=-0.000
min0.157-0.153=0.005
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.446-21.449=-0.003
σ0.003-0.011=-0.008
min21.442-21.443=-0.001
max21.451-21.480=-0.028
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.065=0.000
σ0.003-0.002=0.001
min0.062-0.063=-0.002
max0.073-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.529-1754.525=0.004
σ0.359-0.362=-0.003
min1753.953-1753.954=-0.001
max1755.109-1755.107=0.002
mean1646.700-1660.050=-13.350
σ627.768-648.344=-20.576
min628.000-622.000=6.000
max2856.000-2805.000=51.000
mean2.796-2.771=0.025
σ0.183-0.221=-0.039
min2.318-2.266=0.052
max3.078-3.127=-0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.609-273.604=0.006
σ0.006-0.005=0.000
min273.604-273.597=0.007
max273.617-273.608=0.009
mean2856.000-2805.000=51.000
σ0.000
min2856.000-2805.000=51.000
max2856.000-2805.000=51.000
mean0.388-0.384=0.004
σ0.007-0.004=0.003
min0.383-0.382=0.001
max0.401-0.391=0.010
iters=5
new-facts=1
prior-facts=6402
mean1934.004-1934.000=0.004
σ0.014-0.007=0.008
min1933.984-1933.994=-0.010
max1934.020-1934.010=0.010
mean2856.000-2805.000=51.000
σ0.000
min2856.000-2805.000=51.000
max2856.000-2805.000=51.000
mean3.001-2.992=0.010
σ0.193-0.084=0.108
min2.690-2.870=-0.180
max3.211-3.103=0.108
iters=5
new-facts=6402
prior-facts=1
mean4754.740-4754.556=0.184
σ0.862-1.059=-0.197
min4754.256-4753.308=0.948
max4756.272-4756.243=0.029
mean2856.000-2805.000=51.000
σ0.000
min2856.000-2805.000=51.000
max2856.000-2805.000=51.000
mean8.600-8.284=0.316
σ0.527-0.357=0.170
min7.887-7.716=0.172
max9.219-8.676=0.543
iters=5
new-facts=6402
prior-facts=6402
mean4945.153-4945.148=0.005
σ0.166-0.145=0.021
min4944.858-4944.891=-0.033
max4945.247-4945.230=0.017
mean3062.400-3065.200=-2.800
σ218.291-326.460=-108.169
min2856.000-2805.000=51.000
max3380.000-3562.000=-182.000
mean8.620-8.560=0.059
σ0.166-0.385=-0.218
min8.487-8.361=0.126
max8.899-9.248=-0.349

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.057-1.025=0.032
σ0.136-0.139=-0.003
min0.928-0.929=-0.001
max1.265-1.251=0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.845-472.844=0.000
σ574.925-574.931=-0.006
min185.375-185.372=0.003
max1335.232-1335.241=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2856.000-2805.000=51.000
σ0.000
min2856.000-2805.000=51.000
max2856.000-2805.000=51.000
mean0.457-0.478=-0.021
σ0.308-0.394=-0.086
min0.301-0.266=0.034
max0.918-1.069=-0.150
policies=20
mean1854.037-1853.997=0.039
σ0.376-0.365=0.011
min1853.756-1853.737=0.019
max1854.578-1854.538=0.041
mean840.000
σ0.000
min840.000
max840.000
mean2856.000-2805.000=51.000
σ0.000
min2856.000-2805.000=51.000
max2856.000-2805.000=51.000
mean2.988-2.857=0.131
σ0.014-0.016=-0.002
min2.976-2.836=0.141
max3.008-2.873=0.135
policies=200
mean18546.699-18546.722=-0.023
σ0.476-0.491=-0.016
min18546.336-18546.456=-0.120
max18547.384-18547.458=-0.073
mean8400.000
σ0.000
min8400.000
max8400.000
mean2856.000-2805.000=51.000
σ0.000
min2856.000-2805.000=51.000
max2856.000-2805.000=51.000
mean29.374-28.826=0.548
σ0.474-0.074=0.400
min29.008-28.757=0.251
max30.051-28.929=1.123