Compare commits

Home / Compare 0a6ad964 .. 0224641f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.732=0.048
σ0.052-0.044=0.009
min70.749-70.708=0.041
max70.927-70.852=0.075
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.158-0.158=0.000
σ0.004-0.003=0.002
min0.152-0.155=-0.003
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.494-21.446=0.048
σ0.002-0.002=-0.000
min21.490-21.442=0.048
max21.498-21.448=0.050
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.064-0.063=0.001
σ0.004-0.003=0.000
min0.059-0.059=0.000
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1754.529=-2.648
σ0.361-0.360=0.001
min1751.310-1753.960=-2.650
max1752.467-1755.112=-2.645
mean1665.400-1650.550=14.850
σ627.395-639.738=-12.343
min684.000-616.000=68.000
max2757.000-2785.000=-28.000
mean2.815-2.826=-0.011
σ0.138-0.184=-0.046
min2.435-2.178=0.257
max2.991-3.100=-0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.377-273.607=-4.230
σ0.004-0.010=-0.006
min269.373-273.598=-4.225
max269.382-273.623=-4.241
mean2757.000-2785.000=-28.000
σ0.000
min2757.000-2785.000=-28.000
max2757.000-2785.000=-28.000
mean0.376-0.383=-0.007
σ0.005-0.004=0.001
min0.371-0.380=-0.009
max0.384-0.390=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1929.752-1933.997=-4.244
σ0.004-0.002=0.001
min1929.747-1933.993=-4.246
max1929.755-1933.999=-4.244
mean2757.000-2785.000=-28.000
σ0.000
min2757.000-2785.000=-28.000
max2757.000-2785.000=-28.000
mean3.083-3.054=0.029
σ0.104-0.116=-0.012
min2.989-2.915=0.075
max3.197-3.216=-0.020
iters=5
new-facts=6402
prior-facts=1
mean4750.378-4754.760=-4.382
σ0.931-0.837=0.094
min4749.631-4754.306=-4.674
max4752.005-4756.250=-4.245
mean2757.000-2785.000=-28.000
σ0.000
min2757.000-2785.000=-28.000
max2757.000-2785.000=-28.000
mean8.476-8.464=0.013
σ0.459-0.521=-0.062
min7.809-7.617=0.191
max8.925-8.948=-0.024
iters=5
new-facts=6402
prior-facts=6402
mean4940.987-4945.153=-4.166
σ0.015-0.143=-0.127
min4940.968-4944.898=-3.931
max4941.000-4945.232=-4.232
mean3042.800-3034.800=8.000
σ239.603-255.453=-15.850
min2757.000-2785.000=-28.000
max3331.000-3398.000=-67.000
mean8.511-8.696=-0.185
σ0.123-0.300=-0.177
min8.373-8.419=-0.046
max8.683-9.118=-0.435

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.993-1.025=-0.032
σ0.142-0.132=0.010
min0.923-0.936=-0.013
max1.247-1.237=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.699-472.851=-10.151
σ574.941-574.961=-0.020
min175.223-185.364=-10.141
max1325.111-1335.292=-10.181
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2757.000-2785.000=-28.000
σ0.000
min2757.000-2785.000=-28.000
max2757.000-2785.000=-28.000
mean0.562-0.497=0.065
σ0.568-0.421=0.147
min0.275-0.285=-0.010
max1.414-1.129=0.285
policies=20
mean1752.491-1853.990=-101.499
σ0.354-0.385=-0.030
min1752.265-1853.720=-101.455
max1753.020-1854.557=-101.538
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2757.000-2785.000=-28.000
σ0.000
min2757.000-2785.000=-28.000
max2757.000-2785.000=-28.000
mean2.730-2.886=-0.155
σ0.015-0.011=0.005
min2.715-2.875=-0.160
max2.748-2.901=-0.153
policies=200
mean17532.226-18546.611=-1014.385
σ0.528-0.439=0.088
min17531.864-18546.295=-1014.431
max17533.002-18547.260=-1014.259
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2757.000-2785.000=-28.000
σ0.000
min2757.000-2785.000=-28.000
max2757.000-2785.000=-28.000
mean27.581-28.885=-1.304
σ0.043-0.035=0.008
min27.535-28.837=-1.302
max27.637-28.921=-1.284