Compare commits

Home / Compare 2b2cd3b3 .. 2ad3baeb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.914=0.001
σ0.368-0.367=0.001
min53.783-53.783=0.000
max54.962-54.959=0.003
mean414.800-416.400=-1.600
σ0.422-1.265=-0.843
min414.000
max415.000-417.000=-2.000
mean0.139-0.139=0.001
σ0.004-0.004=-0.000
min0.135-0.134=0.001
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=-0.001
σ0.008-0.005=0.003
min43.128-43.136=-0.008
max43.157-43.152=0.005
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.119-0.121=-0.001
σ0.004-0.003=0.001
min0.113-0.117=-0.004
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.813-991.807=0.006
σ1.243-1.268=-0.025
min991.232-991.229=0.004
max997.039-997.148=-0.109
mean1068.000-1069.000=-1.000
σ318.957-320.946=-1.989
min602.000-574.000=28.000
max1641.000-1632.000=9.000
mean1.535-1.551=-0.016
σ0.059-0.086=-0.027
min1.458-1.469=-0.011
max1.676-1.793=-0.117

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.410=-0.002
σ0.009-0.016=-0.006
min285.396-285.386=0.009
max285.421-285.426=-0.005
mean1641.000-1632.000=9.000
σ0.000
min1641.000-1632.000=9.000
max1641.000-1632.000=9.000
mean0.375-0.377=-0.002
σ0.007-0.007=-0.000
min0.369-0.373=-0.004
max0.384-0.390=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.376-1285.348=0.028
σ0.125-0.070=0.055
min1285.315-1285.308=0.007
max1285.600-1285.473=0.127
mean1641.000-1632.000=9.000
σ0.000
min1641.000-1632.000=9.000
max1641.000-1632.000=9.000
mean2.122-1.926=0.196
σ0.277-0.142=0.135
min1.843-1.816=0.028
max2.439-2.172=0.267
iters=5
new-facts=6402
prior-facts=1
mean1807.736-1807.784=-0.049
σ6.991-6.972=0.019
min1804.381-1804.433=-0.052
max1820.225-1820.243=-0.018
mean1641.000-1632.000=9.000
σ0.000
min1641.000-1632.000=9.000
max1641.000-1632.000=9.000
mean4.270-4.474=-0.205
σ0.169-0.256=-0.088
min4.074-4.183=-0.109
max4.454-4.883=-0.429
iters=5
new-facts=6402
prior-facts=6402
mean2070.199-2070.199=-0.000
σ0.012-0.008=0.004
min2070.184-2070.187=-0.003
max2070.219-2070.209=0.009
mean1852.000-1848.000=4.000
σ187.900-189.178=-1.278
min1641.000-1632.000=9.000
max2088.000-2085.000=3.000
mean4.610-4.544=0.067
σ0.126-0.044=0.082
min4.483-4.490=-0.007
max4.810-4.582=0.228

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.121-1.272=-0.151
σ0.195-0.295=-0.100
min0.906-1.032=-0.126
max1.404-1.754=-0.350

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.785=0.001
σ572.351-572.359=-0.008
min150.597-150.595=0.003
max1295.312-1295.323=-0.011
mean90.250
σ8.500
min86.000
max103.000
mean1641.000-1632.000=9.000
σ0.000
min1641.000-1632.000=9.000
max1641.000-1632.000=9.000
mean0.529-0.518=0.011
σ0.560-0.536=0.024
min0.248-0.249=-0.001
max1.370-1.323=0.047
policies=20
mean1506.266-1506.236=0.029
σ0.229-0.236=-0.006
min1506.119-1506.080=0.039
max1506.608-1506.587=0.021
mean860.000
σ0.000
min860.000
max860.000
mean1641.000-1632.000=9.000
σ0.000
min1641.000-1632.000=9.000
max1641.000-1632.000=9.000
mean2.513-2.509=0.003
σ0.007-0.017=-0.010
min2.503-2.484=0.020
max2.520-2.521=-0.001
policies=200
mean15070.282-15070.166=0.116
σ0.071-0.027=0.043
min15070.204-15070.135=0.070
max15070.366-15070.190=0.176
mean8600.000
σ0.000
min8600.000
max8600.000
mean1641.000-1632.000=9.000
σ0.000
min1641.000-1632.000=9.000
max1641.000-1632.000=9.000
mean25.416-25.416=0.000
σ0.198-0.078=0.120
min25.177-25.326=-0.150
max25.637-25.497=0.140