Compare commits

Home / Compare d7bd5056 .. 3313d5c0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.569=-0.001
σ0.045-0.045=-0.001
min70.540-70.540=-0.000
max70.691-70.692=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.160-0.165=-0.005
σ0.003-0.010=-0.008
min0.158-0.154=0.005
max0.166-0.182=-0.016
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.003=0.000
min21.282-21.284=-0.002
max21.292-21.291=0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.001
min0.063-0.063=0.000
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.568=0.001
σ0.362-0.362=-0.000
min1752.998-1752.995=0.004
max1754.164-1754.169=-0.005
mean1650.550-1669.050=-18.500
σ616.427-628.132=-11.705
min689.000-688.000=1.000
max2763.000-2768.000=-5.000
mean2.752-2.740=0.012
σ0.151-0.201=-0.050
min2.477-2.153=0.324
max2.962-2.987=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.014-272.002=0.011
σ0.005-0.017=-0.012
min272.008-271.988=0.021
max272.021-272.026=-0.006
mean2763.000-2768.000=-5.000
σ0.000
min2763.000-2768.000=-5.000
max2763.000-2768.000=-5.000
mean0.391-0.394=-0.003
σ0.007-0.003=0.004
min0.379-0.392=-0.012
max0.399-0.400=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.445-1932.437=0.008
σ0.009-0.014=-0.006
min1932.435-1932.427=0.008
max1932.459-1932.461=-0.002
mean2763.000-2768.000=-5.000
σ0.000
min2763.000-2768.000=-5.000
max2763.000-2768.000=-5.000
mean2.899-2.975=-0.076
σ0.174-0.172=0.002
min2.691-2.687=0.004
max3.056-3.144=-0.088
iters=5
new-facts=6402
prior-facts=1
mean4753.041-4753.151=-0.110
σ0.637-0.943=-0.306
min4752.666-4752.638=0.027
max4754.173-4754.832=-0.660
mean2763.000-2768.000=-5.000
σ0.000
min2763.000-2768.000=-5.000
max2763.000-2768.000=-5.000
mean8.721-8.672=0.049
σ0.241-0.553=-0.312
min8.377-7.872=0.505
max9.000-9.304=-0.305
iters=5
new-facts=6402
prior-facts=6402
mean4943.630-4943.630=0.000
σ0.014-0.017=-0.004
min4943.617-4943.609=0.008
max4943.652-4943.650=0.002
mean3029.400-3034.200=-4.800
σ238.358-250.400=-12.043
min2763.000-2768.000=-5.000
max3333.000-3376.000=-43.000
mean8.641-8.602=0.039
σ0.213-0.183=0.030
min8.417-8.417=0.000
max8.908-8.853=0.055

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.035-1.062=-0.027
σ0.137-0.129=0.009
min0.943-0.946=-0.003
max1.258-1.259=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.091-473.075=0.016
σ575.948-575.922=0.027
min185.114-185.110=0.004
max1337.014-1336.958=0.056
mean88.250
σ8.500
min84.000
max101.000
mean2763.000-2768.000=-5.000
σ0.000
min2763.000-2768.000=-5.000
max2763.000-2768.000=-5.000
mean0.587-0.450=0.137
σ0.600-0.307=0.293
min0.285-0.292=-0.007
max1.487-0.910=0.577
policies=20
mean1851.412-1851.433=-0.021
σ0.375-0.335=0.040
min1851.152-1851.182=-0.030
max1851.966-1851.923=0.043
mean840.000
σ0.000
min840.000
max840.000
mean2763.000-2768.000=-5.000
σ0.000
min2763.000-2768.000=-5.000
max2763.000-2768.000=-5.000
mean2.867-2.910=-0.043
σ0.009-0.092=-0.083
min2.858-2.845=0.013
max2.876-3.045=-0.169
policies=200
mean18521.098-18520.915=0.182
σ0.548-0.473=0.075
min18520.675-18520.592=0.083
max18521.897-18521.608=0.289
mean8400.000
σ0.000
min8400.000
max8400.000
mean2763.000-2768.000=-5.000
σ0.000
min2763.000-2768.000=-5.000
max2763.000-2768.000=-5.000
mean28.871-28.800=0.071
σ0.079-0.107=-0.028
min28.765-28.691=0.073
max28.956-28.947=0.010