Compare commits

Home / Compare 749731a7 .. 95079ece

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.783=-0.002
σ0.046-0.047=-0.001
min70.756-70.755=0.001
max70.909-70.914=-0.005
mean413.100-413.000=0.100
σ0.316-0.000=0.316
min413.000
max414.000-413.000=1.000
mean0.158-0.161=-0.003
σ0.005-0.003=0.002
min0.150-0.158=-0.008
max0.166-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.001
σ0.002-0.002=0.000
min21.489-21.490=-0.001
max21.495-21.496=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.001
min0.064-0.059=0.004
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.094=-0.001
σ0.362-0.362=0.000
min1753.529-1753.522=0.007
max1754.682-1754.676=0.006
mean1663.250-1665.550=-2.300
σ625.609-632.140=-6.531
min668.000-671.000=-3.000
max2672.000-2621.000=51.000
mean2.793-2.685=0.109
σ0.138-0.254=-0.117
min2.516-2.250=0.266
max3.105-3.109=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.599-271.593=0.006
σ0.004-0.009=-0.005
min271.594-271.587=0.007
max271.605-271.608=-0.003
mean2672.000-2621.000=51.000
σ0.000
min2672.000-2621.000=51.000
max2672.000-2621.000=51.000
mean0.385-0.379=0.006
σ0.011-0.001=0.011
min0.378-0.377=0.001
max0.405-0.379=0.026
iters=5
new-facts=1
prior-facts=6402
mean1931.990-1932.003=-0.013
σ0.016-0.010=0.006
min1931.971-1931.992=-0.021
max1932.011-1932.015=-0.004
mean2672.000-2621.000=51.000
σ0.000
min2672.000-2621.000=51.000
max2672.000-2621.000=51.000
mean2.533-2.524=0.010
σ0.123-0.072=0.051
min2.460-2.455=0.005
max2.749-2.638=0.112
iters=5
new-facts=6402
prior-facts=1
mean4752.622-4752.780=-0.157
σ0.994-0.841=0.153
min4751.636-4752.248=-0.612
max4754.297-4754.270=0.027
mean2672.000-2621.000=51.000
σ0.000
min2672.000-2621.000=51.000
max2672.000-2621.000=51.000
mean8.540-8.313=0.228
σ0.561-0.505=0.056
min7.636-7.636=0.000
max9.181-8.940=0.241
iters=5
new-facts=6402
prior-facts=6402
mean4943.204-4943.137=0.067
σ0.019-0.148=-0.129
min4943.176-4942.873=0.303
max4943.223-4943.221=0.002
mean2953.000-3010.200=-57.200
σ328.769-292.275=36.494
min2672.000-2621.000=51.000
max3450.000-3384.000=66.000
mean8.398-8.471=-0.073
σ0.060-0.092=-0.033
min8.321-8.332=-0.011
max8.479-8.559=-0.080

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.303=-0.108
σ0.363-0.293=0.070
min0.929-1.065=-0.136
max1.801-1.762=0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.616-468.608=0.008
σ574.893-574.886=0.007
min181.163-181.165=-0.002
max1330.954-1330.936=0.018
mean88.250
σ8.500
min84.000
max101.000
mean2672.000-2621.000=51.000
σ0.000
min2672.000-2621.000=51.000
max2672.000-2621.000=51.000
mean0.567-0.562=0.005
σ0.547-0.523=0.024
min0.290-0.290=-0.000
max1.388-1.347=0.041
policies=20
mean1811.948-1811.926=0.022
σ0.362-0.381=-0.020
min1811.705-1811.668=0.038
max1812.482-1812.489=-0.007
mean840.000
σ0.000
min840.000
max840.000
mean2672.000-2621.000=51.000
σ0.000
min2672.000-2621.000=51.000
max2672.000-2621.000=51.000
mean2.831-2.817=0.014
σ0.015-0.016=-0.001
min2.809-2.795=0.014
max2.845-2.832=0.013
policies=200
mean18126.633-18126.662=-0.029
σ0.587-0.417=0.170
min18126.237-18126.301=-0.064
max18127.486-18127.263=0.222
mean8400.000
σ0.000
min8400.000
max8400.000
mean2672.000-2621.000=51.000
σ0.000
min2672.000-2621.000=51.000
max2672.000-2621.000=51.000
mean28.409-28.546=-0.137
σ0.072-0.277=-0.205
min28.316-28.325=-0.009
max28.484-28.947=-0.463