Compare commits

Home / Compare b21ec9c2 .. 3e398c43

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.917=-0.002
σ0.366-0.368=-0.002
min53.777-53.793=-0.016
max54.955-54.963=-0.008
mean415.800-416.000=-0.200
σ0.422-0.000=0.422
min415.000-416.000=-1.000
max416.000
mean0.139-0.147=-0.008
σ0.004-0.014=-0.010
min0.135-0.131=0.005
max0.145-0.165=-0.020
cache=y
dps=1
iters=10
policies=100
mean43.142-43.141=0.001
σ0.007-0.004=0.003
min43.130-43.134=-0.004
max43.152-43.147=0.005
mean416.000
σ0.000
min416.000
max416.000
mean0.121-0.119=0.002
σ0.004-0.004=-0.000
min0.118-0.114=0.004
max0.126-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.064-992.079=-0.016
σ1.227-1.232=-0.004
min991.522-991.499=0.023
max997.231-997.254=-0.024
mean1073.500-1065.950=7.550
σ323.514-315.137=8.377
min609.000-604.000=5.000
max1644.000-1593.000=51.000
mean1.546-1.574=-0.027
σ0.095-0.134=-0.039
min1.458-1.469=-0.010
max1.793-2.044=-0.252

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.675-285.677=-0.001
σ0.009-0.012=-0.003
min285.663-285.664=-0.000
max285.684-285.692=-0.008
mean1644.000-1593.000=51.000
σ0.000
min1644.000-1593.000=51.000
max1644.000-1593.000=51.000
mean0.380-0.379=0.001
σ0.006-0.009=-0.003
min0.375-0.373=0.002
max0.390-0.396=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.642-1285.641=0.002
σ0.139-0.129=0.009
min1285.574-1285.572=0.003
max1285.891-1285.872=0.019
mean1644.000-1593.000=51.000
σ0.000
min1644.000-1593.000=51.000
max1644.000-1593.000=51.000
mean1.910-1.888=0.022
σ0.078-0.163=-0.085
min1.827-1.736=0.091
max2.018-2.124=-0.106
iters=5
new-facts=6402
prior-facts=1
mean1808.020-1807.981=0.039
σ7.011-6.975=0.036
min1804.660-1804.578=0.082
max1820.546-1820.441=0.105
mean1644.000-1593.000=51.000
σ0.000
min1644.000-1593.000=51.000
max1644.000-1593.000=51.000
mean4.313-4.170=0.143
σ0.190-0.226=-0.036
min4.101-3.888=0.213
max4.540-4.451=0.089
iters=5
new-facts=6402
prior-facts=6402
mean2070.462-2070.459=0.003
σ0.005-0.008=-0.003
min2070.455-2070.452=0.004
max2070.467-2070.470=-0.003
mean1852.000-1874.800=-22.800
σ186.731-205.883=-19.152
min1644.000-1605.000=39.000
max2087.000-2090.000=-3.000
mean4.533-4.521=0.012
σ0.056-0.149=-0.093
min4.467-4.327=0.141
max4.587-4.680=-0.094

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.240-1.376=-0.136
σ0.382-0.372=0.010
min0.918-0.923=-0.005
max1.865-1.766=0.099

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.386-437.374=0.012
σ572.358-572.344=0.014
min151.197-151.199=-0.001
max1295.923-1295.890=0.034
mean90.250
σ8.500
min86.000
max103.000
mean1644.000-1593.000=51.000
σ0.000
min1644.000-1593.000=51.000
max1644.000-1593.000=51.000
mean0.533-0.534=-0.001
σ0.561-0.562=-0.001
min0.251-0.250=0.001
max1.375-1.377=-0.002
policies=20
mean1512.206-1512.202=0.004
σ0.235-0.238=-0.003
min1512.054-1512.047=0.007
max1512.557-1512.557=-0.000
mean860.000
σ0.000
min860.000
max860.000
mean1644.000-1593.000=51.000
σ0.000
min1644.000-1593.000=51.000
max1644.000-1593.000=51.000
mean2.517-2.527=-0.010
σ0.018-0.028=-0.009
min2.495-2.507=-0.011
max2.534-2.567=-0.032
policies=200
mean15129.603-15129.730=-0.127
σ0.108-0.050=0.058
min15129.483-15129.702=-0.220
max15129.729-15129.805=-0.076
mean8600.000
σ0.000
min8600.000
max8600.000
mean1644.000-1593.000=51.000
σ0.000
min1644.000-1593.000=51.000
max1644.000-1593.000=51.000
mean25.581-25.576=0.005
σ0.100-0.060=0.040
min25.497-25.513=-0.016
max25.711-25.639=0.072