Compare commits

Home / Compare 92c40c2e .. 0a8f9400

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.646=0.001
σ0.368-0.366=0.002
min53.519-53.510=0.009
max54.694-54.689=0.005
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.139-0.139=-0.000
σ0.004-0.004=0.000
min0.135-0.135=-0.000
max0.146-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.941-42.942=-0.001
σ0.005-0.007=-0.002
min42.934-42.932=0.003
max42.950-42.956=-0.006
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.119-0.120=-0.001
σ0.004-0.005=-0.001
min0.114-0.113=0.001
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.807-991.808=-0.001
σ1.263-1.259=0.004
min991.229-991.223=0.006
max997.121-997.102=0.018
mean1065.350-1062.750=2.600
σ322.224-322.525=-0.301
min569.000-567.000=2.000
max1637.000-1635.000=2.000
mean1.537-1.528=0.009
σ0.080-0.090=-0.010
min1.461-1.414=0.047
max1.780-1.752=0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.392-285.394=-0.001
σ0.013-0.016=-0.003
min285.371-285.371=0.001
max285.405-285.412=-0.007
mean1637.000-1635.000=2.000
σ0.000
min1637.000-1635.000=2.000
max1637.000-1635.000=2.000
mean0.381-0.375=0.006
σ0.007-0.001=0.006
min0.376-0.375=0.001
max0.389-0.376=0.013
iters=5
new-facts=1
prior-facts=6402
mean1285.349-1285.353=-0.005
σ0.117-0.132=-0.015
min1285.294-1285.287=0.007
max1285.559-1285.590=-0.031
mean1637.000-1635.000=2.000
σ0.000
min1637.000-1635.000=2.000
max1637.000-1635.000=2.000
mean1.880-1.876=0.004
σ0.085-0.077=0.008
min1.804-1.768=0.036
max2.023-1.954=0.069
iters=5
new-facts=6402
prior-facts=1
mean1807.689-1807.682=0.007
σ7.011-7.018=-0.008
min1804.330-1804.302=0.028
max1820.215-1820.221=-0.006
mean1637.000-1635.000=2.000
σ0.000
min1637.000-1635.000=2.000
max1637.000-1635.000=2.000
mean4.195-4.115=0.079
σ0.212-0.239=-0.026
min3.844-3.800=0.044
max4.379-4.445=-0.066
iters=5
new-facts=6402
prior-facts=6402
mean2070.178-2070.175=0.003
σ0.010-0.009=0.001
min2070.166-2070.164=0.002
max2070.194-2070.188=0.006
mean1851.000-1845.200=5.800
σ176.187-174.464=1.723
min1637.000-1635.000=2.000
max2095.000-2088.000=7.000
mean4.503-4.446=0.057
σ0.044-0.048=-0.004
min4.453-4.397=0.056
max4.552-4.515=0.037

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.210-1.092=0.118
σ0.358-0.203=0.155
min0.910-0.905=0.005
max1.790-1.377=0.413

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.779-436.777=0.002
σ572.362-572.361=0.001
min150.589-150.588=0.000
max1295.323-1295.319=0.004
mean90.250
σ8.500
min86.000
max103.000
mean1637.000-1635.000=2.000
σ0.000
min1637.000-1635.000=2.000
max1637.000-1635.000=2.000
mean0.528-0.505=0.023
σ0.557-0.511=0.046
min0.246-0.248=-0.002
max1.364-1.272=0.092
policies=20
mean1506.170-1506.166=0.004
σ0.243-0.221=0.022
min1506.016-1506.022=-0.006
max1506.532-1506.496=0.037
mean860.000
σ0.000
min860.000
max860.000
mean1637.000-1635.000=2.000
σ0.000
min1637.000-1635.000=2.000
max1637.000-1635.000=2.000
mean2.526-2.499=0.028
σ0.023-0.021=0.002
min2.502-2.480=0.022
max2.549-2.527=0.022
policies=200
mean15069.442-15069.510=-0.067
σ0.113-0.066=0.047
min15069.327-15069.439=-0.112
max15069.548-15069.581=-0.033
mean8600.000
σ0.000
min8600.000
max8600.000
mean1637.000-1635.000=2.000
σ0.000
min1637.000-1635.000=2.000
max1637.000-1635.000=2.000
mean25.438-25.425=0.013
σ0.154-0.196=-0.042
min25.222-25.201=0.022
max25.552-25.635=-0.082