Compare commits

Home / Compare ad9e0782 .. 2c3e92db

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.000
σ0.369-0.366=0.002
min53.788-53.781=0.007
max54.963-54.956=0.007
mean416.000-414.100=1.900
σ0.000-0.316=-0.316
min416.000-414.000=2.000
max416.000-415.000=1.000
mean0.137-0.138=-0.001
σ0.005-0.006=-0.001
min0.130-0.129=0.002
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.140-43.140=0.001
σ0.006-0.008=-0.002
min43.132-43.126=0.006
max43.150-43.156=-0.006
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.118=0.003
σ0.004-0.004=0.000
min0.112-0.113=-0.001
max0.128-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.818-991.808=0.010
σ1.237-1.242=-0.005
min991.232-991.231=0.001
max997.011-997.035=-0.024
mean1072.850-1073.600=-0.750
σ314.819-318.872=-4.053
min625.000-616.000=9.000
max1634.000
mean1.533-1.528=0.004
σ0.103-0.070=0.033
min1.380-1.462=-0.082
max1.885-1.735=0.150

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.410=0.002
σ0.015-0.012=0.003
min285.386-285.395=-0.009
max285.423-285.423=0.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.383-0.380=0.003
σ0.007-0.008=-0.001
min0.376-0.374=0.002
max0.392-0.390=0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.372-1285.378=-0.006
σ0.130-0.135=-0.005
min1285.308-1285.314=-0.005
max1285.604-1285.619=-0.015
mean1634.000
σ0.000
min1634.000
max1634.000
mean1.996-2.039=-0.043
σ0.240-0.221=0.019
min1.752-1.820=-0.068
max2.372-2.410=-0.038
iters=5
new-facts=6402
prior-facts=1
mean1807.704-1807.736=-0.031
σ7.030-6.991=0.038
min1804.328-1804.397=-0.069
max1820.264-1820.227=0.037
mean1634.000
σ0.000
min1634.000
max1634.000
mean4.158-4.255=-0.097
σ0.218-0.149=0.068
min3.806-4.103=-0.297
max4.403-4.455=-0.052
iters=5
new-facts=6402
prior-facts=6402
mean2070.200-2070.209=-0.009
σ0.011-0.035=-0.024
min2070.192-2070.186=0.006
max2070.220-2070.270=-0.051
mean1839.000-1838.000=1.000
σ176.770-187.293=-10.523
min1634.000
max2077.000-2094.000=-17.000
mean4.521-4.535=-0.014
σ0.052-0.239=-0.187
min4.466-4.345=0.121
max4.584-4.952=-0.369

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.165-1.195=-0.030
σ0.323-0.228=0.095
min0.906-0.918=-0.012
max1.692-1.504=0.188

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.782-436.782=0.001
σ572.360-572.366=-0.006
min150.596-150.596=-0.000
max1295.322-1295.331=-0.008
mean90.250
σ8.500
min86.000
max103.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.514-0.522=-0.009
σ0.520-0.543=-0.023
min0.252-0.247=0.006
max1.293-1.336=-0.043
policies=20
mean1506.269-1506.267=0.001
σ0.244-0.239=0.005
min1506.114-1506.104=0.010
max1506.632-1506.622=0.010
mean860.000
σ0.000
min860.000
max860.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean2.519-2.514=0.005
σ0.016-0.013=0.002
min2.506-2.503=0.003
max2.536-2.531=0.005
policies=200
mean15070.414-15070.414=0.000
σ0.063-0.062=0.002
min15070.354-15070.329=0.025
max15070.502-15070.470=0.032
mean8600.000
σ0.000
min8600.000
max8600.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean25.504-25.490=0.014
σ0.098-0.177=-0.079
min25.388-25.320=0.068
max25.621-25.666=-0.044