Compare commits

Home / Compare ed7bf3c7 .. 3b9e0c38

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.007-54.006=0.001
σ0.366-0.368=-0.002
min53.872-53.877=-0.005
max55.048-55.053=-0.005
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.137-0.140=-0.003
σ0.004-0.003=0.001
min0.130-0.138=-0.008
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.214-43.215=-0.001
σ0.006-0.014=-0.008
min43.203-43.203=0.000
max43.222-43.249=-0.027
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.123-0.117=0.005
σ0.004-0.004=0.000
min0.118-0.110=0.009
max0.128-0.125=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.362-992.368=-0.006
σ1.255-1.254=0.002
min991.783-991.782=0.001
max997.645-997.639=0.007
mean1072.550-1074.250=-1.700
σ315.601-317.368=-1.766
min606.000-592.000=14.000
max1636.000-1632.000=4.000
mean1.505-1.515=-0.010
σ0.054-0.082=-0.027
min1.420-1.397=0.023
max1.635-1.795=-0.160

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean287.356-287.359=-0.003
σ0.013-0.012=0.001
min287.334-287.340=-0.006
max287.368-287.370=-0.002
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.371-0.377=-0.006
σ0.004-0.003=0.000
min0.369-0.374=-0.005
max0.377-0.383=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1287.324-1287.276=0.049
σ0.141-0.026=0.115
min1287.257-1287.262=-0.005
max1287.577-1287.321=0.255
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean1.851-1.889=-0.038
σ0.031-0.102=-0.071
min1.816-1.808=0.008
max1.901-2.017=-0.116
iters=5
new-facts=6402
prior-facts=1
mean1809.615-1809.671=-0.055
σ7.016-7.007=0.009
min1806.254-1806.283=-0.029
max1822.152-1822.190=-0.039
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean4.002-4.245=-0.243
σ0.214-0.301=-0.088
min3.800-3.853=-0.053
max4.343-4.649=-0.306
iters=5
new-facts=6402
prior-facts=6402
mean2072.159-2072.159=0.000
σ0.009-0.007=0.002
min2072.151-2072.152=-0.001
max2072.172-2072.169=0.003
mean1861.200-1842.200=19.000
σ199.754-195.001=4.754
min1636.000-1632.000=4.000
max2090.000-2085.000=5.000
mean4.918-4.940=-0.022
σ0.097-0.099=-0.002
min4.853-4.795=0.058
max5.089-5.063=0.025

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.205-1.258=-0.052
σ0.330-0.346=-0.017
min0.912-0.909=0.004
max1.761-1.737=0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.411-437.414=-0.003
σ572.404-572.400=0.004
min151.200-151.203=-0.003
max1296.018-1296.015=0.003
mean90.250
σ8.500
min86.000
max103.000
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.530-0.511=0.019
σ0.546-0.510=0.035
min0.256-0.255=0.001
max1.348-1.277=0.071
policies=20
mean1512.308-1512.309=-0.001
σ0.252-0.241=0.011
min1512.150-1512.160=-0.011
max1512.684-1512.669=0.015
mean860.000
σ0.000
min860.000
max860.000
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean2.534-2.528=0.006
σ0.013-0.006=0.008
min2.514-2.521=-0.007
max2.541-2.535=0.007
policies=200
mean15130.697-15130.790=-0.093
σ0.212-0.112=0.100
min15130.450-15130.669=-0.219
max15130.967-15130.896=0.071
mean8600.000
σ0.000
min8600.000
max8600.000
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean25.581-25.583=-0.002
σ0.095-0.117=-0.022
min25.474-25.478=-0.005
max25.685-25.741=-0.056