Compare commits

Home / Compare af1c8895 .. 40c8538a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.565=0.000
σ0.046-0.046=-0.001
min70.543-70.540=0.002
max70.693-70.693=-0.000
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.158-0.155=0.004
σ0.004-0.005=-0.000
min0.154-0.149=0.005
max0.166-0.163=0.003
cache=y
dps=1
iters=10
policies=100
mean21.292-21.288=0.003
σ0.011-0.004=0.007
min21.285-21.281=0.003
max21.321-21.294=0.027
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.065-0.064=0.001
σ0.003-0.003=-0.000
min0.063-0.063=0.001
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.372=0.196
σ0.363-0.360=0.002
min1752.996-1752.809=0.187
max1754.150-1753.939=0.211
mean1666.850-1649.350=17.500
σ631.374-645.063=-13.689
min685.000-633.000=52.000
max2702.000-2883.000=-181.000
mean2.756-2.733=0.023
σ0.148-0.183=-0.034
min2.393-2.299=0.093
max2.940-2.975=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.990-271.758=0.232
σ0.010-0.006=0.004
min271.975-271.750=0.225
max272.001-271.766=0.235
mean2702.000-2883.000=-181.000
σ0.000
min2702.000-2883.000=-181.000
max2702.000-2883.000=-181.000
mean0.385-0.386=-0.002
σ0.005-0.009=-0.003
min0.381-0.379=0.002
max0.394-0.398=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.442-1932.173=0.269
σ0.009-0.013=-0.004
min1932.434-1932.157=0.277
max1932.455-1932.193=0.262
mean2702.000-2883.000=-181.000
σ0.000
min2702.000-2883.000=-181.000
max2702.000-2883.000=-181.000
mean2.958-3.035=-0.078
σ0.197-0.119=0.079
min2.643-2.942=-0.299
max3.189-3.228=-0.039
iters=5
new-facts=6402
prior-facts=1
mean4753.069-4752.925=0.144
σ0.912-0.836=0.076
min4752.270-4752.488=-0.218
max4754.640-4754.414=0.226
mean2702.000-2883.000=-181.000
σ0.000
min2702.000-2883.000=-181.000
max2702.000-2883.000=-181.000
mean8.381-8.463=-0.082
σ0.345-0.346=-0.000
min7.821-7.901=-0.080
max8.730-8.781=-0.050
iters=5
new-facts=6402
prior-facts=6402
mean4943.631-4943.374=0.258
σ0.019-0.013=0.006
min4943.616-4943.361=0.255
max4943.655-4943.396=0.259
mean3044.000-3067.600=-23.600
σ283.499-199.159=84.340
min2702.000-2883.000=-181.000
max3429.000-3364.000=65.000
mean8.534-8.615=-0.081
σ0.105-0.251=-0.146
min8.417-8.371=0.047
max8.634-8.970=-0.336

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.023=0.037
σ0.141-0.123=0.018
min0.921-0.934=-0.014
max1.251-1.206=0.045

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.081-472.854=0.227
σ575.922-575.914=0.007
min185.111-184.891=0.220
max1336.963-1336.725=0.238
mean88.250
σ8.500
min84.000
max101.000
mean2702.000-2883.000=-181.000
σ0.000
min2702.000-2883.000=-181.000
max2702.000-2883.000=-181.000
mean0.561-0.449=0.112
σ0.546-0.307=0.239
min0.286-0.293=-0.008
max1.380-0.909=0.471
policies=20
mean1851.430-1849.207=2.223
σ0.376-0.368=0.008
min1851.175-1848.931=2.244
max1851.985-1849.741=2.244
mean840.000
σ0.000
min840.000
max840.000
mean2702.000-2883.000=-181.000
σ0.000
min2702.000-2883.000=-181.000
max2702.000-2883.000=-181.000
mean2.849-2.947=-0.098
σ0.012-0.013=-0.000
min2.831-2.940=-0.110
max2.856-2.966=-0.110
policies=200
mean18521.017-18498.640=22.377
σ0.478-0.405=0.073
min18520.712-18498.261=22.451
max18521.719-18499.204=22.515
mean8400.000
σ0.000
min8400.000
max8400.000
mean2702.000-2883.000=-181.000
σ0.000
min2702.000-2883.000=-181.000
max2702.000-2883.000=-181.000
mean28.763-29.278=-0.515
σ0.040-0.398=-0.358
min28.720-28.913=-0.193
max28.813-29.687=-0.875