Compare commits

Home / Compare 6236cd06 .. 08b9a495

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.572-70.572=-0.000
σ0.044-0.046=-0.001
min70.531-70.544=-0.013
max70.691-70.695=-0.004
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.159-0.158=0.001
σ0.003-0.005=-0.002
min0.155-0.149=0.006
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.290-21.292=-0.001
σ0.003-0.002=0.001
min21.284-21.287=-0.003
max21.296-21.296=0.000
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.065-0.065=0.000
σ0.003-0.002=0.001
min0.063-0.063=0.000
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.172-1753.173=-0.001
σ0.361-0.361=0.000
min1752.609-1752.604=0.005
max1753.744-1753.748=-0.005
mean1654.100-1651.500=2.600
σ640.517-618.098=22.419
min631.000-667.000=-36.000
max2839.000-2650.000=189.000
mean2.849-2.856=-0.007
σ0.134-0.131=0.003
min2.666-2.415=0.250
max3.237-3.045=0.193

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.614-271.619=-0.005
σ0.007-0.004=0.003
min271.602-271.614=-0.011
max271.620-271.625=-0.005
mean2839.000-2650.000=189.000
σ0.000
min2839.000-2650.000=189.000
max2839.000-2650.000=189.000
mean0.374-0.382=-0.008
σ0.007-0.007=0.000
min0.369-0.377=-0.008
max0.387-0.394=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1932.047-1932.038=0.008
σ0.012-0.007=0.005
min1932.033-1932.033=-0.000
max1932.064-1932.051=0.013
mean2839.000-2650.000=189.000
σ0.000
min2839.000-2650.000=189.000
max2839.000-2650.000=189.000
mean2.963-3.004=-0.042
σ0.272-0.086=0.186
min2.506-2.866=-0.361
max3.208-3.083=0.125
iters=5
new-facts=6402
prior-facts=1
mean4752.742-4752.744=-0.002
σ0.913-0.942=-0.029
min4751.853-4751.969=-0.116
max4754.290-4754.379=-0.089
mean2839.000-2650.000=189.000
σ0.000
min2839.000-2650.000=189.000
max2839.000-2650.000=189.000
mean7.888-8.033=-0.145
σ0.299-0.440=-0.141
min7.612-7.642=-0.030
max8.379-8.742=-0.362
iters=5
new-facts=6402
prior-facts=6402
mean4943.184-4943.171=0.013
σ0.149-0.156=-0.007
min4942.919-4942.895=0.023
max4943.265-4943.264=0.002
mean3053.400-3004.800=48.600
σ263.995-387.956=-123.961
min2839.000-2650.000=189.000
max3444.000-3562.000=-118.000
mean8.521-8.505=0.016
σ0.195-0.241=-0.045
min8.390-8.274=0.115
max8.862-8.803=0.059

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.116-1.189=-0.073
σ0.096-0.336=-0.240
min1.072-0.936=0.136
max1.287-1.746=-0.458

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.296-472.289=0.007
σ575.921-575.927=-0.006
min184.325-184.320=0.005
max1336.177-1336.180=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2839.000-2650.000=189.000
σ0.000
min2839.000-2650.000=189.000
max2839.000-2650.000=189.000
mean0.452-0.550=-0.098
σ0.308-0.529=-0.220
min0.296-0.283=0.013
max0.914-1.343=-0.429
policies=20
mean1843.569-1843.538=0.031
σ0.382-0.387=-0.005
min1843.289-1843.280=0.009
max1844.125-1844.110=0.015
mean840.000
σ0.000
min840.000
max840.000
mean2839.000-2650.000=189.000
σ0.000
min2839.000-2650.000=189.000
max2839.000-2650.000=189.000
mean2.956-2.882=0.075
σ0.013-0.041=-0.027
min2.945-2.848=0.098
max2.976-2.940=0.035
policies=200
mean18441.989-18442.031=-0.041
σ0.401-0.492=-0.091
min18441.663-18441.728=-0.064
max18442.512-18442.765=-0.253
mean8400.000
σ0.000
min8400.000
max8400.000
mean2839.000-2650.000=189.000
σ0.000
min2839.000-2650.000=189.000
max2839.000-2650.000=189.000
mean29.210-28.978=0.232
σ0.666-0.100=0.565
min28.797-28.874=-0.078
max30.204-29.064=1.140