Compare commits

Home / Compare d135937e .. acd5d204

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.957=-0.000
σ0.103-0.103=-0.000
min35.915-35.912=0.002
max36.247-36.248=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.076-0.077=-0.001
σ0.006-0.004=0.001
min0.069-0.074=-0.005
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean26.204-26.204=-0.000
σ0.006-0.004=0.002
min26.195-26.197=-0.001
max26.214-26.210=0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.060-0.061=-0.000
σ0.003-0.003=0.000
min0.059-0.059=-0.000
max0.068-0.068=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.306-1756.304=0.002
σ0.370-0.369=0.001
min1755.729-1755.730=-0.001
max1756.901-1756.896=0.005
mean1666.550-1648.800=17.750
σ651.604-628.816=22.788
min629.000-611.000=18.000
max2847.000-2726.000=121.000
mean2.327-2.366=-0.038
σ0.064-0.150=-0.086
min2.249-2.096=0.153
max2.465-2.803=-0.339

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.822-278.824=-0.002
σ0.008-0.006=0.002
min278.814-278.817=-0.003
max278.835-278.833=0.002
mean2847.000-2726.000=121.000
σ0.000
min2847.000-2726.000=121.000
max2847.000-2726.000=121.000
mean0.413-0.412=0.001
σ0.004-0.005=-0.001
min0.408-0.408=-0.000
max0.417-0.418=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.879-2268.886=-0.007
σ0.006-0.011=-0.005
min2268.870-2268.878=-0.009
max2268.886-2268.906=-0.020
mean2847.000-2726.000=121.000
σ0.000
min2847.000-2726.000=121.000
max2847.000-2726.000=121.000
mean2.924-3.067=-0.143
σ0.104-0.151=-0.047
min2.852-2.890=-0.039
max3.108-3.224=-0.116
iters=5
new-facts=6402
prior-facts=1
mean4954.303-4954.144=0.159
σ0.902-1.074=-0.173
min4953.751-4953.093=0.658
max4955.903-4955.948=-0.045
mean2847.000-2726.000=121.000
σ0.000
min2847.000-2726.000=121.000
max2847.000-2726.000=121.000
mean7.916-8.124=-0.208
σ0.282-0.420=-0.138
min7.705-7.675=0.030
max8.405-8.680=-0.275
iters=5
new-facts=6402
prior-facts=6402
mean5168.752-5168.829=-0.077
σ0.135-0.094=0.041
min5168.550-5168.725=-0.175
max5168.877-5168.907=-0.030
mean3392.400-3321.800=70.600
σ439.040-391.547=47.493
min2847.000-2933.000=-86.000
max3998.000-3716.000=282.000
mean9.237-9.475=-0.238
σ0.203-0.403=-0.199
min9.007-9.121=-0.113
max9.545-10.014=-0.470

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.949-0.993=-0.045
σ0.006-0.074=-0.068
min0.942-0.929=0.013
max0.959-1.084=-0.125

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.363-459.812=0.551
σ572.656-571.578=1.077
min174.029-174.018=0.011
max1319.346-1317.179=2.167
mean79.500
σ7.000
min76.000
max90.000
mean2847.000-2726.000=121.000
σ0.000
min2847.000-2726.000=121.000
max2847.000-2726.000=121.000
mean0.431-0.533=-0.102
σ0.307-0.536=-0.229
min0.277-0.265=0.012
max0.892-1.338=-0.445
policies=20
mean1740.605-1740.433=0.172
σ0.359-0.307=0.052
min1740.392-1740.252=0.140
max1741.142-1740.893=0.249
mean760.000
σ0.000
min760.000
max760.000
mean2847.000-2726.000=121.000
σ0.000
min2847.000-2726.000=121.000
max2847.000-2726.000=121.000
mean2.778-2.669=0.110
σ0.025-0.005=0.020
min2.758-2.664=0.094
max2.814-2.676=0.138
policies=200
mean17411.439-17411.240=0.199
σ0.647-0.379=0.267
min17410.852-17411.012=-0.160
max17412.130-17411.808=0.322
mean7600.000
σ0.000
min7600.000
max7600.000
mean2847.000-2726.000=121.000
σ0.000
min2847.000-2726.000=121.000
max2847.000-2726.000=121.000
mean27.230-26.927=0.303
σ0.356-0.089=0.267
min27.021-26.847=0.174
max27.761-27.053=0.708