Compare commits

Home / Compare 5035d9bf .. 5f3ee152

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.562=0.005
σ0.044-0.049=-0.005
min70.537-70.537=0.000
max70.686-70.699=-0.013
mean414.000
σ0.000
min414.000
max414.000
mean0.157-0.154=0.003
σ0.005-0.005=0.000
min0.149-0.149=-0.000
max0.163-0.163=0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.291=-0.002
σ0.003-0.011=-0.008
min21.284-21.284=-0.001
max21.292-21.322=-0.030
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.065=-0.000
σ0.002-0.002=-0.000
min0.063-0.063=-0.000
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.175-1753.173=0.003
σ0.360-0.360=-0.001
min1752.602-1752.607=-0.005
max1753.754-1753.763=-0.009
mean1656.250-1669.850=-13.600
σ645.081-641.805=3.275
min627.000-692.000=-65.000
max2897.000-2842.000=55.000
mean2.868-2.739=0.129
σ0.094-0.212=-0.119
min2.651-2.153=0.498
max3.025-3.033=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.622-271.625=-0.003
σ0.008-0.005=0.003
min271.609-271.619=-0.010
max271.629-271.629=0.000
mean2897.000-2842.000=55.000
σ0.000
min2897.000-2842.000=55.000
max2897.000-2842.000=55.000
mean0.380-0.382=-0.001
σ0.001-0.002=-0.000
min0.378-0.380=-0.001
max0.382-0.384=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.047-1932.040=0.007
σ0.013-0.013=0.000
min1932.035-1932.024=0.011
max1932.069-1932.056=0.012
mean2897.000-2842.000=55.000
σ0.000
min2897.000-2842.000=55.000
max2897.000-2842.000=55.000
mean3.029-3.019=0.010
σ0.336-0.093=0.243
min2.462-2.953=-0.491
max3.316-3.182=0.134
iters=5
new-facts=6402
prior-facts=1
mean4752.803-4752.811=-0.008
σ0.814-0.834=-0.020
min4752.249-4752.285=-0.036
max4754.243-4754.291=-0.048
mean2897.000-2842.000=55.000
σ0.000
min2897.000-2842.000=55.000
max2897.000-2842.000=55.000
mean8.159-8.189=-0.030
σ0.708-0.639=0.069
min7.649-7.668=-0.019
max9.266-9.109=0.158
iters=5
new-facts=6402
prior-facts=6402
mean4943.239-4943.241=-0.003
σ0.011-0.018=-0.007
min4943.224-4943.217=0.007
max4943.254-4943.260=-0.007
mean3132.000-3059.200=72.800
σ272.725-273.472=-0.747
min2897.000-2842.000=55.000
max3516.000-3478.000=38.000
mean8.622-8.641=-0.019
σ0.210-0.371=-0.161
min8.391-8.390=0.001
max8.844-9.277=-0.434

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.056=-0.032
σ0.142-0.130=0.012
min0.929-0.934=-0.005
max1.254-1.252=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.289-472.292=-0.003
σ575.918-575.915=0.003
min184.318-184.328=-0.010
max1336.165-1336.164=0.001
mean88.250
σ8.500
min84.000
max101.000
mean2897.000-2842.000=55.000
σ0.000
min2897.000-2842.000=55.000
max2897.000-2842.000=55.000
mean0.487-0.452=0.036
σ0.359-0.302=0.058
min0.304-0.299=0.005
max1.026-0.904=0.122
policies=20
mean1843.564-1843.570=-0.006
σ0.375-0.381=-0.006
min1843.273-1843.291=-0.018
max1844.104-1844.121=-0.017
mean840.000
σ0.000
min840.000
max840.000
mean2897.000-2842.000=55.000
σ0.000
min2897.000-2842.000=55.000
max2897.000-2842.000=55.000
mean2.990-2.980=0.010
σ0.050-0.018=0.032
min2.958-2.963=-0.005
max3.064-3.001=0.063
policies=200
mean18442.125-18442.237=-0.113
σ0.380-0.479=-0.099
min18441.904-18441.930=-0.026
max18442.691-18442.951=-0.261
mean8400.000
σ0.000
min8400.000
max8400.000
mean2897.000-2842.000=55.000
σ0.000
min2897.000-2842.000=55.000
max2897.000-2842.000=55.000
mean29.304-29.327=-0.023
σ0.464-0.418=0.046
min28.881-28.929=-0.048
max29.820-29.913=-0.093