Compare commits

Home / Compare df48e69e .. cac17a20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.915=0.000
σ0.366-0.367=-0.000
min53.788-53.786=0.002
max54.958-54.959=-0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.140-0.139=0.001
σ0.004-0.004=-0.001
min0.137-0.133=0.004
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.141-43.142=-0.001
σ0.004-0.005=-0.001
min43.134-43.136=-0.002
max43.146-43.149=-0.004
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.119-0.124=-0.005
σ0.005-0.003=0.002
min0.113-0.121=-0.008
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.806-991.817=-0.010
σ1.252-1.248=0.004
min991.246-991.231=0.015
max997.077-997.062=0.016
mean1061.550-1069.500=-7.950
σ322.451-313.777=8.674
min564.000-617.000=-53.000
max1637.000-1653.000=-16.000
mean1.545-1.528=0.017
σ0.074-0.077=-0.002
min1.479-1.443=0.036
max1.731-1.747=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.408=0.001
σ0.013-0.009=0.004
min285.391-285.393=-0.002
max285.423-285.416=0.007
mean1637.000-1653.000=-16.000
σ0.000
min1637.000-1653.000=-16.000
max1637.000-1653.000=-16.000
mean0.378-0.374=0.003
σ0.003-0.007=-0.004
min0.376-0.367=0.008
max0.383-0.383=0.000
iters=5
new-facts=1
prior-facts=6402
mean1285.374-1285.369=0.005
σ0.129-0.123=0.006
min1285.314-1285.307=0.007
max1285.605-1285.589=0.016
mean1637.000-1653.000=-16.000
σ0.000
min1637.000-1653.000=-16.000
max1637.000-1653.000=-16.000
mean1.872-1.932=-0.060
σ0.038-0.142=-0.104
min1.818-1.840=-0.022
max1.917-2.182=-0.265
iters=5
new-facts=6402
prior-facts=1
mean1807.695-1807.692=0.003
σ7.025-7.011=0.014
min1804.311-1804.338=-0.027
max1820.249-1820.222=0.027
mean1637.000-1653.000=-16.000
σ0.000
min1637.000-1653.000=-16.000
max1637.000-1653.000=-16.000
mean4.114-4.163=-0.049
σ0.260-0.284=-0.023
min3.899-3.761=0.137
max4.516-4.435=0.081
iters=5
new-facts=6402
prior-facts=6402
mean2070.199-2070.197=0.002
σ0.010-0.011=-0.000
min2070.184-2070.180=0.003
max2070.212-2070.210=0.002
mean1849.200-1838.000=11.200
σ175.992-165.947=10.045
min1637.000-1653.000=-16.000
max2093.000-2072.000=21.000
mean4.452-4.601=-0.149
σ0.041-0.208=-0.167
min4.389-4.453=-0.064
max4.500-4.969=-0.468

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.226-1.226=-0.000
σ0.314-0.294=0.020
min0.914-1.030=-0.116
max1.738-1.733=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.789=-0.004
σ572.359-572.358=0.001
min150.598-150.604=-0.006
max1295.323-1295.326=-0.002
mean90.250
σ8.500
min86.000
max103.000
mean1637.000-1653.000=-16.000
σ0.000
min1637.000-1653.000=-16.000
max1637.000-1653.000=-16.000
mean0.529-0.513=0.016
σ0.559-0.517=0.043
min0.247-0.254=-0.007
max1.368-1.288=0.080
policies=20
mean1506.265-1506.269=-0.004
σ0.246-0.236=0.010
min1506.109-1506.116=-0.007
max1506.631-1506.620=0.011
mean860.000
σ0.000
min860.000
max860.000
mean1637.000-1653.000=-16.000
σ0.000
min1637.000-1653.000=-16.000
max1637.000-1653.000=-16.000
mean2.522-2.512=0.011
σ0.015-0.012=0.003
min2.501-2.496=0.005
max2.535-2.525=0.010
policies=200
mean15070.305-15070.312=-0.008
σ0.093-0.035=0.057
min15070.195-15070.260=-0.065
max15070.416-15070.335=0.081
mean8600.000
σ0.000
min8600.000
max8600.000
mean1637.000-1653.000=-16.000
σ0.000
min1637.000-1653.000=-16.000
max1637.000-1653.000=-16.000
mean25.514-25.443=0.071
σ0.082-0.132=-0.050
min25.445-25.306=0.140
max25.619-25.608=0.011