Compare commits

Home / Compare edf745c5 .. ce640087

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.562=0.005
σ0.047-0.046=0.002
min70.542-70.539=0.002
max70.699-70.691=0.008
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.162-0.156=0.006
σ0.003-0.005=-0.002
min0.159-0.149=0.010
max0.168-0.162=0.005
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.000
σ0.004-0.002=0.001
min21.283-21.284=-0.001
max21.294-21.292=0.002
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.001
min0.062-0.059=0.003
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.565-1753.569=-0.004
σ0.361-0.357=0.004
min1752.998-1753.000=-0.001
max1754.148-1754.127=0.022
mean1652.800-1663.250=-10.450
σ643.221-633.850=9.372
min626.000-688.000=-62.000
max2883.000-2750.000=133.000
mean2.770-2.798=-0.028
σ0.166-0.208=-0.042
min2.312-2.411=-0.099
max2.966-3.356=-0.390

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.018-272.014=0.004
σ0.008-0.010=-0.002
min272.009-271.997=0.012
max272.028-272.021=0.007
mean2883.000-2750.000=133.000
σ0.000
min2883.000-2750.000=133.000
max2883.000-2750.000=133.000
mean0.391-0.391=0.000
σ0.011-0.013=-0.002
min0.379-0.372=0.007
max0.402-0.404=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.429-1932.440=-0.011
σ0.015-0.009=0.006
min1932.406-1932.428=-0.023
max1932.444-1932.453=-0.009
mean2883.000-2750.000=133.000
σ0.000
min2883.000-2750.000=133.000
max2883.000-2750.000=133.000
mean3.036-2.931=0.105
σ0.094-0.156=-0.061
min2.941-2.731=0.209
max3.148-3.129=0.019
iters=5
new-facts=6402
prior-facts=1
mean4753.177-4753.038=0.140
σ0.828-0.971=-0.143
min4752.726-4752.044=0.682
max4754.651-4754.657=-0.006
mean2883.000-2750.000=133.000
σ0.000
min2883.000-2750.000=133.000
max2883.000-2750.000=133.000
mean8.427-8.752=-0.324
σ0.465-0.397=0.068
min7.734-8.437=-0.702
max8.909-9.398=-0.490
iters=5
new-facts=6402
prior-facts=6402
mean4943.631-4943.563=0.068
σ0.016-0.166=-0.150
min4943.617-4943.268=0.349
max4943.655-4943.652=0.004
mean3083.600-3032.600=51.000
σ220.531-231.498=-10.967
min2883.000-2750.000=133.000
max3418.000-3304.000=114.000
mean8.588-8.622=-0.034
σ0.120-0.181=-0.060
min8.451-8.401=0.050
max8.701-8.894=-0.193

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.996-1.025=-0.028
σ0.145-0.145=0.000
min0.928-0.920=0.009
max1.256-1.261=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.078-473.085=-0.008
σ575.914-575.921=-0.007
min185.120-185.116=0.004
max1336.949-1336.968=-0.018
mean88.250
σ8.500
min84.000
max101.000
mean2883.000-2750.000=133.000
σ0.000
min2883.000-2750.000=133.000
max2883.000-2750.000=133.000
mean0.451-0.559=-0.108
σ0.301-0.536=-0.235
min0.299-0.290=0.009
max0.903-1.363=-0.460
policies=20
mean1851.437-1851.439=-0.002
σ0.368-0.374=-0.006
min1851.171-1851.179=-0.009
max1851.972-1851.992=-0.020
mean840.000
σ0.000
min840.000
max840.000
mean2883.000-2750.000=133.000
σ0.000
min2883.000-2750.000=133.000
max2883.000-2750.000=133.000
mean2.949-2.879=0.070
σ0.004-0.008=-0.004
min2.946-2.871=0.075
max2.954-2.890=0.064
policies=200
mean18521.134-18520.951=0.182
σ0.494-0.436=0.058
min18520.810-18520.623=0.187
max18521.861-18521.581=0.280
mean8400.000
σ0.000
min8400.000
max8400.000
mean2883.000-2750.000=133.000
σ0.000
min2883.000-2750.000=133.000
max2883.000-2750.000=133.000
mean29.285-28.964=0.321
σ0.440-0.152=0.288
min28.906-28.834=0.072
max29.756-29.154=0.602