Compare commits

Home / Compare 14838ed5 .. 4d76a440

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.566=-0.002
σ0.046-0.046=-0.000
min70.539-70.541=-0.002
max70.694-70.693=0.000
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.161-0.155=0.005
σ0.004-0.004=-0.001
min0.156-0.148=0.008
max0.166-0.161=0.005
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.000
σ0.003-0.003=0.000
min21.283-21.282=0.001
max21.292-21.291=0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.061-0.065=-0.004
σ0.003-0.002=0.000
min0.058-0.063=-0.004
max0.067-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.175-1753.568=-0.392
σ0.361-0.358=0.004
min1752.603-1752.998=-0.395
max1753.761-1754.131=-0.369
mean1650.850-1658.450=-7.600
σ642.395-634.535=7.861
min629.000-642.000=-13.000
max2878.000-2856.000=22.000
mean2.901-2.834=0.067
σ0.115-0.184=-0.068
min2.563-2.477=0.086
max3.063-3.229=-0.166

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.622-272.016=-0.395
σ0.005-0.006=-0.001
min271.617-272.009=-0.393
max271.628-272.023=-0.395
mean2878.000-2856.000=22.000
σ0.000
min2878.000-2856.000=22.000
max2878.000-2856.000=22.000
mean0.384-0.393=-0.008
σ0.010-0.010=0.000
min0.376-0.376=-0.001
max0.399-0.402=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.053-1932.436=-0.383
σ0.012-0.008=0.004
min1932.040-1932.421=-0.382
max1932.066-1932.441=-0.376
mean2878.000-2856.000=22.000
σ0.000
min2878.000-2856.000=22.000
max2878.000-2856.000=22.000
mean3.062-2.957=0.104
σ0.128-0.071=0.057
min2.972-2.896=0.076
max3.287-3.078=0.209
iters=5
new-facts=6402
prior-facts=1
mean4752.701-4753.054=-0.353
σ0.893-0.916=-0.024
min4751.945-4752.306=-0.361
max4754.241-4754.643=-0.402
mean2878.000-2856.000=22.000
σ0.000
min2878.000-2856.000=22.000
max2878.000-2856.000=22.000
mean8.159-8.396=-0.237
σ0.582-0.668=-0.087
min7.677-7.748=-0.071
max9.105-9.305=-0.200
iters=5
new-facts=6402
prior-facts=6402
mean4943.150-4943.629=-0.479
σ0.157-0.022=0.135
min4942.871-4943.604=-0.733
max4943.235-4943.654=-0.419
mean3069.600-3057.800=11.800
σ261.915-198.944=62.971
min2878.000-2856.000=22.000
max3479.000-3315.000=164.000
mean8.402-8.641=-0.239
σ0.114-0.199=-0.085
min8.300-8.380=-0.080
max8.595-8.824=-0.229

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.079-1.030=0.050
σ0.126-0.136=-0.010
min0.934-0.939=-0.005
max1.282-1.248=0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.292-473.082=-0.790
σ575.922-575.913=0.008
min184.327-185.114=-0.787
max1336.175-1336.952=-0.777
mean88.250
σ8.500
min84.000
max101.000
mean2878.000-2856.000=22.000
σ0.000
min2878.000-2856.000=22.000
max2878.000-2856.000=22.000
mean0.497-0.488=0.010
σ0.377-0.376=0.000
min0.306-0.295=0.010
max1.062-1.052=0.010
policies=20
mean1843.585-1851.469=-7.884
σ0.376-0.371=0.004
min1843.305-1851.199=-7.894
max1844.131-1852.011=-7.880
mean840.000
σ0.000
min840.000
max840.000
mean2878.000-2856.000=22.000
σ0.000
min2878.000-2856.000=22.000
max2878.000-2856.000=22.000
mean3.006-2.956=0.049
σ0.047-0.020=0.028
min2.963-2.938=0.025
max3.049-2.982=0.067
policies=200
mean18442.234-18521.130=-78.897
σ0.448-0.356=0.091
min18441.896-18520.839=-78.943
max18442.892-18521.650=-78.757
mean8400.000
σ0.000
min8400.000
max8400.000
mean2878.000-2856.000=22.000
σ0.000
min2878.000-2856.000=22.000
max2878.000-2856.000=22.000
mean29.383-29.360=0.023
σ0.430-0.534=-0.104
min29.040-28.851=0.189
max30.011-29.836=0.175