Compare commits

Home / Compare 9a143f48 .. 6a02e5a6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.566=0.002
σ0.046-0.045=0.001
min70.544-70.538=0.007
max70.694-70.688=0.006
mean413.000-414.800=-1.800
σ0.000-0.422=-0.422
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.160-0.159=0.001
σ0.004-0.003=0.001
min0.157-0.156=0.001
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.003=0.000
min21.284-21.285=-0.001
max21.292-21.292=0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.063=0.001
σ0.002-0.003=-0.001
min0.063-0.060=0.003
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.376=-0.001
σ0.360-0.361=-0.001
min1752.807-1752.802=0.005
max1753.966-1753.965=0.001
mean1648.900-1656.400=-7.500
σ644.080-646.966=-2.887
min633.000-636.000=-3.000
max2882.000-2898.000=-16.000
mean2.821-2.829=-0.008
σ0.169-0.199=-0.030
min2.437-2.177=0.260
max3.169-3.037=0.131

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.758=-0.002
σ0.007-0.006=0.001
min271.745-271.751=-0.006
max271.761-271.767=-0.006
mean2882.000-2898.000=-16.000
σ0.000
min2882.000-2898.000=-16.000
max2882.000-2898.000=-16.000
mean0.381-0.380=0.001
σ0.005-0.004=0.001
min0.375-0.378=-0.002
max0.388-0.387=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.179-1932.180=-0.001
σ0.009-0.012=-0.003
min1932.171-1932.163=0.008
max1932.194-1932.197=-0.002
mean2882.000-2898.000=-16.000
σ0.000
min2882.000-2898.000=-16.000
max2882.000-2898.000=-16.000
mean3.035-3.068=-0.033
σ0.092-0.132=-0.040
min2.945-2.919=0.025
max3.190-3.215=-0.026
iters=5
new-facts=6402
prior-facts=1
mean4752.990-4752.839=0.150
σ0.805-0.960=-0.155
min4752.542-4751.809=0.733
max4754.426-4754.418=0.008
mean2882.000-2898.000=-16.000
σ0.000
min2882.000-2898.000=-16.000
max2882.000-2898.000=-16.000
mean7.931-8.286=-0.356
σ0.322-0.624=-0.302
min7.697-7.676=0.021
max8.490-9.176=-0.686
iters=5
new-facts=6402
prior-facts=6402
mean4943.380-4943.385=-0.005
σ0.029-0.017=0.012
min4943.342-4943.364=-0.021
max4943.406-4943.404=0.002
mean3097.800-3063.200=34.600
σ304.842-246.640=58.202
min2882.000-2898.000=-16.000
max3571.000-3450.000=121.000
mean8.595-8.528=0.067
σ0.320-0.143=0.177
min8.367-8.396=-0.028
max9.134-8.745=0.390

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.073-1.052=0.021
σ0.115-0.126=-0.011
min0.928-0.933=-0.004
max1.251-1.246=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.861-467.863=4.999
σ575.926-575.925=0.001
min184.888-179.893=4.995
max1336.750-1331.750=5.000
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2882.000-2898.000=-16.000
σ0.000
min2882.000-2898.000=-16.000
max2882.000-2898.000=-16.000
mean0.486-0.445=0.041
σ0.379-0.301=0.078
min0.292-0.292=-0.001
max1.054-0.897=0.158
policies=20
mean1849.218-1799.176=50.043
σ0.380-0.348=0.032
min1848.933-1798.919=50.014
max1849.770-1799.686=50.083
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2882.000-2898.000=-16.000
σ0.000
min2882.000-2898.000=-16.000
max2882.000-2898.000=-16.000
mean2.942-2.884=0.058
σ0.009-0.019=-0.010
min2.932-2.866=0.067
max2.955-2.908=0.046
policies=200
mean18498.772-17998.312=500.460
σ0.382-0.483=-0.101
min18498.467-17997.988=500.478
max18499.330-17999.031=500.300
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2882.000-2898.000=-16.000
σ0.000
min2882.000-2898.000=-16.000
max2882.000-2898.000=-16.000
mean29.174-28.515=0.659
σ0.447-0.488=-0.041
min28.752-28.078=0.674
max29.656-28.991=0.665