Compare commits

Home / Compare 883d9e0a .. edc75ea6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.914=0.001
σ0.369-0.367=0.002
min53.786-53.775=0.011
max54.964-54.957=0.007
mean414.100-414.800=-0.700
σ0.316-0.422=-0.105
min414.000
max415.000
mean0.139-0.138=0.002
σ0.005-0.003=0.001
min0.135-0.132=0.003
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.140-43.140=0.000
σ0.006-0.008=-0.002
min43.132-43.123=0.009
max43.148-43.152=-0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.121-0.116=0.005
σ0.004-0.002=0.001
min0.118-0.113=0.005
max0.127-0.119=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.817-991.807=0.010
σ1.244-1.225=0.019
min991.230-991.238=-0.008
max997.041-996.956=0.085
mean1064.050-1066.700=-2.650
σ322.173-320.887=1.286
min568.000-589.000=-21.000
max1640.000-1629.000=11.000
mean1.539-1.524=0.016
σ0.090-0.101=-0.012
min1.425-1.389=0.036
max1.770-1.842=-0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.412=0.001
σ0.014-0.011=0.003
min285.391-285.393=-0.003
max285.430-285.420=0.009
mean1640.000-1629.000=11.000
σ0.000
min1640.000-1629.000=11.000
max1640.000-1629.000=11.000
mean0.377-0.374=0.003
σ0.007-0.007=-0.000
min0.371-0.368=0.003
max0.389-0.382=0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.364-1285.373=-0.009
σ0.111-0.132=-0.021
min1285.309-1285.308=0.001
max1285.562-1285.608=-0.046
mean1640.000-1629.000=11.000
σ0.000
min1640.000-1629.000=11.000
max1640.000-1629.000=11.000
mean2.029-1.892=0.137
σ0.265-0.054=0.211
min1.822-1.858=-0.035
max2.449-1.986=0.462
iters=5
new-facts=6402
prior-facts=1
mean1807.715-1807.684=0.031
σ7.004-7.006=-0.002
min1804.353-1804.328=0.026
max1820.229-1820.200=0.029
mean1640.000-1629.000=11.000
σ0.000
min1640.000-1629.000=11.000
max1640.000-1629.000=11.000
mean4.211-4.123=0.089
σ0.230-0.189=0.041
min3.852-3.834=0.018
max4.440-4.348=0.092
iters=5
new-facts=6402
prior-facts=6402
mean2070.197-2070.200=-0.003
σ0.009-0.014=-0.005
min2070.186-2070.183=0.002
max2070.207-2070.219=-0.011
mean1836.400-1838.800=-2.400
σ173.961-191.937=-17.976
min1640.000-1629.000=11.000
max2073.000-2083.000=-10.000
mean4.593-4.513=0.081
σ0.160-0.111=0.049
min4.474-4.434=0.040
max4.871-4.709=0.163

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.259-1.170=0.089
σ0.316-0.259=0.057
min0.908-0.902=0.006
max1.695-1.583=0.112

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.790-436.787=0.003
σ572.363-572.363=-0.001
min150.598-150.600=-0.002
max1295.334-1295.332=0.002
mean90.250
σ8.500
min86.000
max103.000
mean1640.000-1629.000=11.000
σ0.000
min1640.000-1629.000=11.000
max1640.000-1629.000=11.000
mean0.539-0.524=0.016
σ0.580-0.548=0.032
min0.248-0.246=0.002
max1.409-1.345=0.064
policies=20
mean1506.267-1506.269=-0.002
σ0.236-0.220=0.017
min1506.108-1506.125=-0.017
max1506.618-1506.597=0.022
mean860.000
σ0.000
min860.000
max860.000
mean1640.000-1629.000=11.000
σ0.000
min1640.000-1629.000=11.000
max1640.000-1629.000=11.000
mean2.505-2.495=0.010
σ0.016-0.017=-0.000
min2.488-2.482=0.005
max2.526-2.519=0.007
policies=200
mean15070.386-15070.273=0.113
σ0.097-0.115=-0.018
min15070.241-15070.154=0.087
max15070.449-15070.413=0.035
mean8600.000
σ0.000
min8600.000
max8600.000
mean1640.000-1629.000=11.000
σ0.000
min1640.000-1629.000=11.000
max1640.000-1629.000=11.000
mean25.523-25.397=0.127
σ0.183-0.191=-0.008
min25.362-25.215=0.147
max25.742-25.563=0.180