Compare commits

Home / Compare 8f01e843 .. 3b654f40

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.005-54.006=-0.001
σ0.366-0.367=-0.001
min53.870-53.877=-0.008
max55.047-55.051=-0.004
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.140-0.137=0.003
σ0.004-0.004=-0.000
min0.136-0.131=0.006
max0.147-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.215-43.213=0.003
σ0.013-0.005=0.008
min43.200-43.205=-0.005
max43.246-43.222=0.024
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.120-0.120=-0.000
σ0.004-0.003=0.001
min0.114-0.118=-0.004
max0.127-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.353-992.362=-0.009
σ1.282-1.309=-0.027
min991.796-991.805=-0.010
max997.754-997.880=-0.126
mean1073.850-1068.750=5.100
σ321.654-313.709=7.945
min565.000-591.000=-26.000
max1632.000-1646.000=-14.000
mean1.545-1.525=0.020
σ0.085-0.120=-0.036
min1.449-1.393=0.056
max1.765-1.985=-0.220

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean287.360-287.358=0.002
σ0.015-0.012=0.003
min287.335-287.337=-0.002
max287.373-287.369=0.005
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean0.378-0.373=0.005
σ0.006-0.005=0.002
min0.372-0.368=0.004
max0.386-0.379=0.006
iters=5
new-facts=1
prior-facts=6402
mean1287.323-1287.325=-0.002
σ0.132-0.139=-0.007
min1287.260-1287.258=0.002
max1287.559-1287.574=-0.015
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean1.936-1.857=0.079
σ0.123-0.052=0.071
min1.812-1.795=0.017
max2.140-1.911=0.230
iters=5
new-facts=6402
prior-facts=1
mean1809.670-1809.658=0.013
σ7.002-7.002=-0.000
min1806.294-1806.293=0.001
max1822.178-1822.170=0.008
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean4.221-4.133=0.088
σ0.193-0.299=-0.106
min3.974-3.764=0.210
max4.443-4.470=-0.028
iters=5
new-facts=6402
prior-facts=6402
mean2072.165-2072.169=-0.004
σ0.021-0.044=-0.022
min2072.153-2072.133=0.020
max2072.203-2072.245=-0.042
mean1837.000-1862.200=-25.200
σ171.971-196.565=-24.594
min1632.000-1646.000=-14.000
max2074.000-2088.000=-14.000
mean4.917-5.100=-0.182
σ0.052-0.235=-0.184
min4.837-4.867=-0.030
max4.978-5.477=-0.499

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.277-1.314=-0.037
σ0.357-0.349=0.008
min0.914-1.033=-0.119
max1.841-1.817=0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.405-437.414=-0.008
σ572.403-572.403=0.001
min151.200-151.206=-0.006
max1296.010-1296.018=-0.007
mean90.250
σ8.500
min86.000
max103.000
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean0.515-0.528=-0.013
σ0.525-0.552=-0.027
min0.250-0.249=0.001
max1.302-1.355=-0.054
policies=20
mean1512.322-1512.301=0.021
σ0.251-0.245=0.006
min1512.157-1512.138=0.018
max1512.696-1512.666=0.030
mean860.000
σ0.000
min860.000
max860.000
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean2.526-2.522=0.004
σ0.015-0.005=0.010
min2.506-2.517=-0.011
max2.538-2.528=0.010
policies=200
mean15130.772-15130.861=-0.089
σ0.043-0.074=-0.032
min15130.727-15130.801=-0.074
max15130.822-15130.968=-0.146
mean8600.000
σ0.000
min8600.000
max8600.000
mean1632.000-1646.000=-14.000
σ0.000
min1632.000-1646.000=-14.000
max1632.000-1646.000=-14.000
mean25.477-25.467=0.010
σ0.189-0.130=0.060
min25.321-25.339=-0.018
max25.751-25.607=0.144