Compare commits

Home / Compare ea6e3b5d .. bc82fb91

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.008-54.005=0.003
σ0.366-0.367=-0.001
min53.879-53.872=0.006
max55.050-55.049=0.001
mean414.000-415.100=-1.100
σ0.000-0.316=-0.316
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.139-0.138=0.001
σ0.004-0.006=-0.002
min0.132-0.131=0.001
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.213-43.213=-0.000
σ0.006-0.008=-0.003
min43.204-43.199=0.005
max43.221-43.231=-0.011
mean414.800-416.000=-1.200
σ0.422-0.000=0.422
min414.000-416.000=-2.000
max415.000-416.000=-1.000
mean0.122-0.121=0.001
σ0.004-0.003=0.001
min0.118-0.118=0.001
max0.129-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.359-992.356=0.002
σ1.262-1.255=0.007
min991.806-991.797=0.009
max997.672-997.639=0.033
mean1067.050-1068.650=-1.600
σ308.060-303.571=4.489
min665.000
max1593.000-1627.000=-34.000
mean1.520-1.537=-0.018
σ0.081-0.122=-0.041
min1.402-1.416=-0.014
max1.747-1.990=-0.242

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean287.357-287.358=-0.001
σ0.010-0.015=-0.006
min287.341-287.333=0.008
max287.365-287.375=-0.010
mean1593.000-1627.000=-34.000
σ0.000
min1593.000-1627.000=-34.000
max1593.000-1627.000=-34.000
mean0.373-0.378=-0.006
σ0.004-0.005=-0.000
min0.370-0.373=-0.003
max0.380-0.383=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1287.324-1287.314=0.009
σ0.139-0.117=0.023
min1287.256-1287.254=0.002
max1287.573-1287.523=0.050
mean1593.000-1627.000=-34.000
σ0.000
min1593.000-1627.000=-34.000
max1593.000-1627.000=-34.000
mean1.853-1.852=0.001
σ0.037-0.044=-0.006
min1.817-1.809=0.008
max1.916-1.902=0.013
iters=5
new-facts=6402
prior-facts=1
mean1809.646-1809.656=-0.010
σ7.019-7.028=-0.009
min1806.278-1806.282=-0.004
max1822.188-1822.215=-0.027
mean1593.000-1627.000=-34.000
σ0.000
min1593.000-1627.000=-34.000
max1593.000-1627.000=-34.000
mean4.111-4.186=-0.075
σ0.255-0.267=-0.011
min3.850-3.885=-0.034
max4.486-4.473=0.013
iters=5
new-facts=6402
prior-facts=6402
mean2072.159-2072.158=0.001
σ0.017-0.008=0.009
min2072.149-2072.150=-0.001
max2072.189-2072.171=0.018
mean1850.400-1849.400=1.000
σ206.729-206.851=-0.122
min1593.000-1627.000=-34.000
max2074.000-2085.000=-11.000
mean4.932-4.895=0.037
σ0.038-0.179=-0.141
min4.877-4.604=0.273
max4.974-5.087=-0.113

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.343-1.198=0.145
σ0.368-0.284=0.084
min0.916-0.916=-0.000
max1.717-1.563=0.154

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.412-437.410=0.002
σ572.407-572.407=-0.001
min151.206-151.203=0.003
max1296.022-1296.021=0.001
mean90.250
σ8.500
min86.000
max103.000
mean1593.000-1627.000=-34.000
σ0.000
min1593.000-1627.000=-34.000
max1593.000-1627.000=-34.000
mean0.521-0.532=-0.011
σ0.540-0.559=-0.019
min0.250-0.249=0.001
max1.331-1.370=-0.040
policies=20
mean1512.316-1512.316=-0.000
σ0.234-0.230=0.004
min1512.159-1512.170=-0.011
max1512.665-1512.660=0.005
mean860.000
σ0.000
min860.000
max860.000
mean1593.000-1627.000=-34.000
σ0.000
min1593.000-1627.000=-34.000
max1593.000-1627.000=-34.000
mean2.512-2.512=0.000
σ0.006-0.025=-0.019
min2.505-2.492=0.013
max2.519-2.548=-0.028
policies=200
mean15130.840-15130.788=0.051
σ0.073-0.131=-0.058
min15130.748-15130.648=0.100
max15130.915-15130.941=-0.025
mean8600.000
σ0.000
min8600.000
max8600.000
mean1593.000-1627.000=-34.000
σ0.000
min1593.000-1627.000=-34.000
max1593.000-1627.000=-34.000
mean25.569-25.467=0.102
σ0.087-0.217=-0.130
min25.490-25.300=0.191
max25.662-25.773=-0.111