Compare commits

Home / Compare aee3cc6b .. eac7f8db

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.913-53.915=-0.001
σ0.366-0.367=-0.001
min53.785-53.788=-0.003
max54.955-54.960=-0.005
mean415.000-414.300=0.700
σ0.000-0.483=-0.483
min415.000-414.000=1.000
max415.000
mean0.138-0.137=0.001
σ0.004-0.005=-0.001
min0.131-0.130=0.001
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.140-43.141=-0.001
σ0.007-0.006=0.001
min43.128-43.131=-0.002
max43.154-43.149=0.005
mean415.000
σ0.000
min415.000
max415.000
mean0.119-0.121=-0.001
σ0.004-0.003=0.001
min0.114-0.117=-0.004
max0.125-0.126=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.082-992.085=-0.003
σ1.233-1.246=-0.012
min991.495-991.495=0.000
max997.260-997.314=-0.054
mean1069.800-1070.750=-0.950
σ319.208-323.017=-3.809
min602.000-573.000=29.000
max1646.000-1637.000=9.000
mean1.526-1.534=-0.009
σ0.079-0.078=0.001
min1.429-1.424=0.005
max1.775-1.760=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.656-285.679=-0.023
σ0.015-0.010=0.005
min285.639-285.661=-0.022
max285.680-285.688=-0.008
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.379-0.377=0.002
σ0.005-0.004=0.001
min0.376-0.372=0.003
max0.388-0.383=0.005
iters=5
new-facts=1
prior-facts=6402
mean1285.636-1285.636=-0.000
σ0.119-0.132=-0.013
min1285.576-1285.573=0.003
max1285.849-1285.872=-0.023
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean1.868-1.885=-0.017
σ0.106-0.062=0.045
min1.720-1.845=-0.126
max2.003-1.994=0.009
iters=5
new-facts=6402
prior-facts=1
mean1807.983-1807.987=-0.003
σ6.992-7.007=-0.015
min1804.634-1804.610=0.024
max1820.477-1820.505=-0.028
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean4.271-4.231=0.040
σ0.185-0.189=-0.004
min4.008-3.985=0.023
max4.428-4.427=0.001
iters=5
new-facts=6402
prior-facts=6402
mean2070.466-2070.460=0.006
σ0.008-0.012=-0.004
min2070.459-2070.444=0.015
max2070.480-2070.479=0.001
mean1850.000-1861.600=-11.600
σ172.599-200.825=-28.226
min1646.000-1637.000=9.000
max2092.000-2093.000=-1.000
mean4.581-4.538=0.043
σ0.156-0.120=0.036
min4.484-4.410=0.074
max4.857-4.689=0.168

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.201-1.206=-0.005
σ0.326-0.286=0.040
min0.918-0.914=0.003
max1.749-1.636=0.113

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.382-437.386=-0.004
σ572.363-572.359=0.005
min151.194-151.199=-0.005
max1295.927-1295.924=0.003
mean90.250
σ8.500
min86.000
max103.000
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.524-0.521=0.002
σ0.543-0.523=0.020
min0.248-0.258=-0.010
max1.339-1.306=0.033
policies=20
mean1512.196-1512.210=-0.014
σ0.238-0.246=-0.008
min1512.053-1512.053=0.000
max1512.551-1512.576=-0.025
mean860.000
σ0.000
min860.000
max860.000
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean2.518-2.527=-0.009
σ0.009-0.009=-0.001
min2.507-2.515=-0.008
max2.528-2.535=-0.007
policies=200
mean15129.636-15129.638=-0.002
σ0.109-0.161=-0.052
min15129.494-15129.449=0.045
max15129.728-15129.778=-0.049
mean8600.000
σ0.000
min8600.000
max8600.000
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean25.616-25.658=-0.042
σ0.140-0.186=-0.046
min25.462-25.516=-0.054
max25.798-25.909=-0.112