Compare commits

Home / Compare 3bbff7e7 .. 58079f87

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.568=-0.002
σ0.045-0.046=-0.001
min70.538-70.544=-0.007
max70.688-70.694=-0.006
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.158-0.160=-0.002
σ0.005-0.004=0.002
min0.150-0.157=-0.007
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.003=0.000
min21.283-21.284=-0.000
max21.294-21.292=0.002
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.064-0.064=0.000
σ0.002-0.002=-0.000
min0.063-0.063=0.000
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.375=0.194
σ0.360-0.360=0.000
min1752.994-1752.807=0.187
max1754.157-1753.966=0.191
mean1654.450-1648.900=5.550
σ634.454-644.080=-9.625
min639.000-633.000=6.000
max2853.000-2882.000=-29.000
mean2.748-2.821=-0.073
σ0.215-0.169=0.046
min2.168-2.437=-0.269
max3.038-3.169=-0.131

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.016-271.756=0.260
σ0.005-0.007=-0.002
min272.010-271.745=0.265
max272.024-271.761=0.263
mean2853.000-2882.000=-29.000
σ0.000
min2853.000-2882.000=-29.000
max2853.000-2882.000=-29.000
mean0.385-0.381=0.004
σ0.009-0.005=0.004
min0.379-0.375=0.004
max0.401-0.388=0.012
iters=5
new-facts=1
prior-facts=6402
mean1932.433-1932.179=0.254
σ0.006-0.009=-0.003
min1932.425-1932.171=0.254
max1932.441-1932.194=0.247
mean2853.000-2882.000=-29.000
σ0.000
min2853.000-2882.000=-29.000
max2853.000-2882.000=-29.000
mean3.046-3.035=0.010
σ0.104-0.092=0.012
min2.965-2.945=0.020
max3.171-3.190=-0.019
iters=5
new-facts=6402
prior-facts=1
mean4753.084-4752.990=0.095
σ0.992-0.805=0.188
min4752.130-4752.542=-0.412
max4754.764-4754.426=0.338
mean2853.000-2882.000=-29.000
σ0.000
min2853.000-2882.000=-29.000
max2853.000-2882.000=-29.000
mean8.285-7.931=0.354
σ0.675-0.322=0.353
min7.682-7.697=-0.016
max9.029-8.490=0.540
iters=5
new-facts=6402
prior-facts=6402
mean4943.555-4943.380=0.176
σ0.161-0.029=0.133
min4943.267-4943.342=-0.075
max4943.636-4943.406=0.230
mean3080.400-3097.800=-17.400
σ299.873-304.842=-4.969
min2853.000-2882.000=-29.000
max3541.000-3571.000=-30.000
mean8.462-8.595=-0.132
σ0.123-0.320=-0.196
min8.356-8.367=-0.011
max8.672-9.134=-0.462

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.105-1.073=0.032
σ0.246-0.115=0.131
min0.927-0.928=-0.001
max1.527-1.251=0.276

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-472.861=0.221
σ575.924-575.926=-0.002
min185.108-184.888=0.221
max1336.968-1336.750=0.218
mean88.250
σ8.500
min84.000
max101.000
mean2853.000-2882.000=-29.000
σ0.000
min2853.000-2882.000=-29.000
max2853.000-2882.000=-29.000
mean0.441-0.486=-0.045
σ0.306-0.379=-0.073
min0.270-0.292=-0.022
max0.899-1.054=-0.155
policies=20
mean1851.425-1849.218=2.207
σ0.381-0.380=0.001
min1851.137-1848.933=2.205
max1851.981-1849.770=2.211
mean840.000
σ0.000
min840.000
max840.000
mean2853.000-2882.000=-29.000
σ0.000
min2853.000-2882.000=-29.000
max2853.000-2882.000=-29.000
mean2.948-2.942=0.006
σ0.005-0.009=-0.004
min2.943-2.932=0.011
max2.953-2.955=-0.001
policies=200
mean18520.989-18498.772=22.217
σ0.483-0.382=0.101
min18520.649-18498.467=22.182
max18521.698-18499.330=22.368
mean8400.000
σ0.000
min8400.000
max8400.000
mean2853.000-2882.000=-29.000
σ0.000
min2853.000-2882.000=-29.000
max2853.000-2882.000=-29.000
mean29.246-29.174=0.072
σ0.486-0.447=0.039
min28.768-28.752=0.016
max29.695-29.656=0.039