Compare commits

Home / Compare 8ddd2025 .. 1b8144d0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.914=0.002
σ0.368-0.367=0.002
min53.786-53.778=0.008
max54.963-54.957=0.006
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.139-0.140=-0.001
σ0.004-0.006=-0.002
min0.136-0.135=0.001
max0.146-0.155=-0.009
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=0.000
σ0.005-0.007=-0.002
min43.133-43.128=0.005
max43.147-43.154=-0.007
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.122-0.120=0.002
σ0.004-0.004=-0.000
min0.119-0.115=0.004
max0.128-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.061-992.076=-0.015
σ1.259-1.228=0.031
min991.512-991.496=0.016
max997.362-997.237=0.125
mean1067.450-1065.700=1.750
σ321.639-315.661=5.978
min575.000-606.000=-31.000
max1631.000-1570.000=61.000
mean1.531-1.532=-0.001
σ0.092-0.070=0.022
min1.443-1.469=-0.026
max1.752-1.749=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.674-285.668=0.006
σ0.008-0.015=-0.007
min285.662-285.641=0.021
max285.682-285.678=0.004
mean1631.000-1570.000=61.000
σ0.000
min1631.000-1570.000=61.000
max1631.000-1570.000=61.000
mean0.373-0.384=-0.010
σ0.001-0.011=-0.010
min0.372-0.374=-0.002
max0.375-0.397=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1285.639-1285.640=-0.000
σ0.128-0.137=-0.009
min1285.574-1285.573=0.001
max1285.869-1285.885=-0.016
mean1631.000-1570.000=61.000
σ0.000
min1631.000-1570.000=61.000
max1631.000-1570.000=61.000
mean1.878-1.942=-0.064
σ0.077-0.152=-0.075
min1.786-1.827=-0.040
max1.997-2.197=-0.200
iters=5
new-facts=6402
prior-facts=1
mean1807.976-1807.995=-0.019
σ7.007-6.981=0.027
min1804.621-1804.636=-0.015
max1820.495-1820.466=0.030
mean1631.000-1570.000=61.000
σ0.000
min1631.000-1570.000=61.000
max1631.000-1570.000=61.000
mean4.196-4.219=-0.023
σ0.171-0.145=0.027
min3.981-4.074=-0.093
max4.449-4.449=-0.000
iters=5
new-facts=6402
prior-facts=6402
mean2070.463-2070.470=-0.007
σ0.008-0.041=-0.033
min2070.455-2070.416=0.039
max2070.476-2070.529=-0.054
mean1845.000-1861.200=-16.200
σ194.170-215.133=-20.963
min1631.000-1599.000=32.000
max2088.000-2102.000=-14.000
mean4.500-4.690=-0.191
σ0.045-0.449=-0.405
min4.455-4.434=0.021
max4.565-5.488=-0.924

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.196-1.490=-0.294
σ0.330-0.298=0.032
min0.912-1.044=-0.132
max1.753-1.769=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.389-437.370=0.019
σ572.363-572.355=0.008
min151.195-151.190=0.006
max1295.934-1295.903=0.031
mean90.250
σ8.500
min86.000
max103.000
mean1631.000-1570.000=61.000
σ0.000
min1631.000-1570.000=61.000
max1631.000-1570.000=61.000
mean0.525-0.514=0.010
σ0.560-0.525=0.035
min0.226-0.250=-0.024
max1.365-1.302=0.063
policies=20
mean1512.209-1512.185=0.024
σ0.246-0.260=-0.014
min1512.051-1512.014=0.036
max1512.576-1512.572=0.004
mean860.000
σ0.000
min860.000
max860.000
mean1631.000-1570.000=61.000
σ0.000
min1631.000-1570.000=61.000
max1631.000-1570.000=61.000
mean2.527-2.535=-0.008
σ0.019-0.012=0.007
min2.506-2.525=-0.019
max2.544-2.550=-0.006
policies=200
mean15129.738-15129.635=0.103
σ0.036-0.081=-0.045
min15129.694-15129.536=0.158
max15129.771-15129.734=0.037
mean8600.000
σ0.000
min8600.000
max8600.000
mean1631.000-1570.000=61.000
σ0.000
min1631.000-1570.000=61.000
max1631.000-1570.000=61.000
mean25.552-25.669=-0.117
σ0.097-0.076=0.021
min25.422-25.594=-0.172
max25.642-25.742=-0.100