Compare commits

Home / Compare c7f1d819 .. c549af9a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.695=-0.000
σ0.047-0.047=0.000
min70.667-70.672=-0.005
max70.827-70.827=-0.000
mean414.200-416.000=-1.800
σ0.422-0.000=0.422
min414.000-416.000=-2.000
max415.000-416.000=-1.000
mean0.157-0.158=-0.000
σ0.004-0.004=-0.000
min0.150-0.151=-0.000
max0.163-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.423-21.420=0.003
σ0.012-0.002=0.010
min21.417-21.417=-0.000
max21.457-21.423=0.033
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.063-0.065=-0.002
σ0.003-0.003=0.000
min0.059-0.063=-0.004
max0.069-0.074=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.457-1754.459=-0.003
σ0.362-0.362=-0.000
min1753.891-1753.890=0.001
max1755.047-1755.059=-0.012
mean1662.200-1663.050=-0.850
σ633.155-635.748=-2.593
min670.000-674.000=-4.000
max2687.000-2688.000=-1.000
mean2.788-2.844=-0.056
σ0.212-0.194=0.018
min2.234-2.163=0.070
max3.057-3.063=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.502-273.500=0.002
σ0.004-0.007=-0.003
min273.498-273.489=0.008
max273.507-273.508=-0.001
mean2687.000-2688.000=-1.000
σ0.000
min2687.000-2688.000=-1.000
max2687.000-2688.000=-1.000
mean0.374-0.373=0.001
σ0.001-0.001=0.000
min0.372-0.372=0.000
max0.375-0.374=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.891-1933.897=-0.006
σ0.020-0.013=0.007
min1933.865-1933.876=-0.011
max1933.913-1933.906=0.007
mean2687.000-2688.000=-1.000
σ0.000
min2687.000-2688.000=-1.000
max2687.000-2688.000=-1.000
mean2.975-2.974=0.002
σ0.162-0.065=0.096
min2.710-2.872=-0.162
max3.108-3.054=0.053
iters=5
new-facts=6402
prior-facts=1
mean4754.605-4754.631=-0.026
σ0.892-0.878=0.014
min4754.167-4754.220=-0.053
max4756.200-4756.201=-0.001
mean2687.000-2688.000=-1.000
σ0.000
min2687.000-2688.000=-1.000
max2687.000-2688.000=-1.000
mean8.883-8.768=0.114
σ0.107-0.109=-0.002
min8.704-8.644=0.060
max8.986-8.930=0.055
iters=5
new-facts=6402
prior-facts=6402
mean4945.124-4944.905=0.219
σ0.018-0.323=-0.305
min4945.109-4944.390=0.719
max4945.144-4945.136=0.008
mean2961.800-2967.000=-5.200
σ262.639-321.950=-59.311
min2687.000-2688.000=-1.000
max3361.000-3430.000=-69.000
mean8.431-8.485=-0.054
σ0.130-0.215=-0.084
min8.329-8.275=0.054
max8.603-8.775=-0.172

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.143-1.076=0.067
σ0.118-0.149=-0.030
min1.055-0.931=0.124
max1.291-1.260=0.031

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.063-473.061=0.001
σ575.930-575.919=0.011
min185.090-185.093=-0.003
max1336.957-1336.940=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2687.000-2688.000=-1.000
σ0.000
min2687.000-2688.000=-1.000
max2687.000-2688.000=-1.000
mean0.560-0.548=0.012
σ0.547-0.535=0.012
min0.286-0.266=0.020
max1.380-1.350=0.029
policies=20
mean1851.261-1851.252=0.010
σ0.380-0.393=-0.012
min1851.002-1850.986=0.016
max1851.823-1851.832=-0.009
mean840.000
σ0.000
min840.000
max840.000
mean2687.000-2688.000=-1.000
σ0.000
min2687.000-2688.000=-1.000
max2687.000-2688.000=-1.000
mean2.873-2.882=-0.009
σ0.011-0.039=-0.028
min2.863-2.853=0.010
max2.883-2.938=-0.055
policies=200
mean18519.354-18519.331=0.023
σ0.522-0.399=0.123
min18518.973-18519.050=-0.077
max18520.116-18519.907=0.210
mean8400.000
σ0.000
min8400.000
max8400.000
mean2687.000-2688.000=-1.000
σ0.000
min2687.000-2688.000=-1.000
max2687.000-2688.000=-1.000
mean28.872-28.844=0.028
σ0.104-0.064=0.040
min28.729-28.759=-0.029
max28.975-28.912=0.063