Compare commits

Home / Compare 2d0690a8 .. 2253aa91

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.000
σ0.365-0.367=-0.002
min53.781-53.785=-0.004
max54.953-54.958=-0.005
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.137-0.139=-0.002
σ0.004-0.004=-0.000
min0.131-0.135=-0.004
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.140-43.141=-0.001
σ0.007-0.006=0.001
min43.127-43.127=-0.000
max43.152-43.150=0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.117-0.121=-0.003
σ0.003-0.003=-0.000
min0.113-0.117=-0.005
max0.123-0.126=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.087-992.079=0.008
σ1.234-1.270=-0.036
min991.497-991.503=-0.006
max997.260-997.425=-0.165
mean1065.500-1066.200=-0.700
σ321.400-315.010=6.389
min573.000-575.000=-2.000
max1643.000-1632.000=11.000
mean1.527-1.537=-0.010
σ0.077-0.082=-0.005
min1.397-1.456=-0.059
max1.705-1.762=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.673-285.676=-0.003
σ0.013-0.012=0.001
min285.652-285.655=-0.003
max285.684-285.684=0.000
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean0.376-0.373=0.003
σ0.007-0.006=0.000
min0.373-0.361=0.011
max0.388-0.376=0.012
iters=5
new-facts=1
prior-facts=6402
mean1285.634-1285.622=0.012
σ0.125-0.093=0.031
min1285.573-1285.573=0.001
max1285.857-1285.788=0.069
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean1.884-1.905=-0.021
σ0.072-0.125=-0.052
min1.816-1.768=0.048
max2.006-2.100=-0.094
iters=5
new-facts=6402
prior-facts=1
mean1808.007-1807.990=0.018
σ7.003-7.021=-0.018
min1804.593-1804.585=0.007
max1820.518-1820.533=-0.015
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean4.316-4.253=0.062
σ0.315-0.266=0.049
min3.961-3.896=0.065
max4.649-4.581=0.067
iters=5
new-facts=6402
prior-facts=6402
mean2070.463-2070.461=0.002
σ0.010-0.011=-0.001
min2070.452-2070.450=0.001
max2070.479-2070.480=-0.001
mean1846.600-1842.600=4.000
σ189.685-184.028=5.657
min1643.000-1632.000=11.000
max2088.000-2080.000=8.000
mean4.453-4.494=-0.041
σ0.018-0.053=-0.035
min4.430-4.434=-0.004
max4.471-4.563=-0.092

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.141-1.169=-0.027
σ0.279-0.256=0.022
min0.903-0.919=-0.015
max1.571-1.580=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.376-437.380=-0.004
σ572.351-572.360=-0.009
min151.196-151.194=0.002
max1295.903-1295.919=-0.017
mean90.250
σ8.500
min86.000
max103.000
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean0.522-0.526=-0.005
σ0.539-0.543=-0.004
min0.249-0.252=-0.003
max1.330-1.341=-0.011
policies=20
mean1512.201-1512.215=-0.014
σ0.263-0.250=0.013
min1512.043-1512.058=-0.015
max1512.594-1512.589=0.005
mean860.000
σ0.000
min860.000
max860.000
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean2.553-2.540=0.013
σ0.049-0.013=0.035
min2.524-2.528=-0.005
max2.626-2.555=0.071
policies=200
mean15129.636-15129.728=-0.092
σ0.137-0.052=0.085
min15129.513-15129.661=-0.148
max15129.770-15129.787=-0.017
mean8600.000
σ0.000
min8600.000
max8600.000
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean25.573-25.636=-0.063
σ0.119-0.154=-0.035
min25.452-25.490=-0.038
max25.704-25.790=-0.086