Compare commits

Home / Compare d0f3cba9 .. d86ced22

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime (s)
cache=disabled
datapoints=1
iterations=10
mean1223.193-167.909=1055.284
σ2.284-0.390=1.894
min1222.327-167.754=1054.572
max1229.603-169.006=1060.597
mean3745.000-3689.000=56.000
σ0.000
min3745.000-3689.000=56.000
max3745.000-3689.000=56.000
mean0.348-0.061=0.286
σ0.012-0.000=0.012
min0.329-0.061=0.268
max0.362-0.062=0.300
cache=enabled
datapoints=1
iterations=10
mean82.805-167.803=-84.999
σ0.002-0.028=-0.026
min82.802-167.768=-84.966
max82.809-167.848=-85.039
mean3745.000-3689.000=56.000
σ0.000
min3745.000-3689.000=56.000
max3745.000-3689.000=56.000
mean0.041-0.061=-0.020
σ0.004-0.000=0.003
min0.040-0.061=-0.021
max0.052-0.062=-0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime (s)
datapoints=1
iterations=20
mean1753.901-1753.900=0.001
σ0.370-0.372=-0.002
min1753.328-1753.329=-0.001
max1754.489-1754.494=-0.005
mean1656.100-1651.950=4.150
σ641.140-636.972=4.169
min613.000-616.000=-3.000
max2629.000-2604.000=25.000
mean2.738-2.751=-0.013
σ0.205-0.173=0.032
min2.174-2.164=0.010
max3.256-2.944=0.311

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime (s)
iters=5
new-facts=1
prior-facts=1
mean190.718-190.717=0.002
σ0.006-0.003=0.003
min190.712-190.713=-0.001
max190.729-190.722=0.007
mean2629.000-2604.000=25.000
σ0.000
min2629.000-2604.000=25.000
max2629.000-2604.000=25.000
mean0.277-0.280=-0.003
σ0.001-0.001=0.000
min0.275-0.280=-0.004
max0.278-0.281=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1989.493-1989.483=0.010
σ0.009-0.024=-0.016
min1989.483-1989.445=0.038
max1989.501-1989.506=-0.004
mean2629.000-2604.000=25.000
σ0.000
min2629.000-2604.000=25.000
max2629.000-2604.000=25.000
mean2.710-2.515=0.195
σ0.151-0.242=-0.091
min2.545-2.225=0.320
max2.905-2.774=0.131
iters=5
new-facts=6402
prior-facts=1
mean4880.173-4880.173=-0.000
σ0.556-0.619=-0.063
min4879.885-4879.890=-0.005
max4881.159-4881.280=-0.121
mean2629.000-2604.000=25.000
σ0.000
min2629.000-2604.000=25.000
max2629.000-2604.000=25.000
mean8.075-8.120=-0.045
σ0.222-0.163=0.059
min7.763-7.879=-0.117
max8.389-8.326=0.064
iters=5
new-facts=6402
prior-facts=6402
mean4891.786-4891.787=-0.001
σ0.011-0.020=-0.009
min4891.770-4891.767=0.003
max4891.798-4891.815=-0.016
mean3284.000-3279.600=4.400
σ496.066-405.594=90.472
min2629.000-2878.000=-249.000
max3745.000-3689.000=56.000
mean8.170-8.202=-0.032
σ0.232-0.286=-0.055
min7.979-7.951=0.028
max8.504-8.620=-0.116

newProductH/cdr_auton/broker

Factortime (s)
iterations=5
mean1.313-1.566=-0.253
σ0.327-0.221=0.105
min0.940-1.204=-0.263
max1.780-1.745=0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime (s)
policies=2
mean456.477-456.477=0.001
σ572.534-572.535=-0.001
min170.210-170.204=0.006
max1315.278-1315.279=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean430.500-431.000=-0.500
σ0.577-1.155=-0.577
min430.000
max431.000-432.000=-1.000
mean0.560-0.574=-0.013
σ0.582-0.597=-0.015
min0.263-0.270=-0.006
max1.433-1.468=-0.036
policies=20
mean1702.590-1702.603=-0.014
σ0.300-0.322=-0.022
min1702.358-1702.361=-0.003
max1703.027-1703.074=-0.047
mean760.000
σ0.000
min760.000
max760.000
mean444.000-445.250=-1.250
σ11.804-11.615=0.189
min431.000-432.000=-1.000
max454.000-455.000=-1.000
mean2.602-2.641=-0.038
σ0.006-0.015=-0.009
min2.594-2.627=-0.033
max2.609-2.660=-0.052
policies=200
mean17035.425-17035.434=-0.009
σ0.051-0.074=-0.023
min17035.350-17035.366=-0.016
max17035.461-17035.531=-0.070
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.750-490.000=-0.250
σ3.500-1.414=2.086
min486.000-489.000=-3.000
max494.000-492.000=2.000
mean26.331-26.457=-0.127
σ0.091-0.209=-0.117
min26.231-26.311=-0.079
max26.449-26.764=-0.315