Compare commits

Home / Compare 388a685a .. 9083c29d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.728-36.727=0.000
σ1.333-0.612=0.722
min35.921-35.932=-0.011
max39.695-37.214=2.480
mean3989.000-3941.000=48.000
σ0.000
min3989.000-3941.000=48.000
max3989.000-3941.000=48.000
mean0.076-0.075=0.001
σ0.003-0.002=0.001
min0.074-0.074=0.001
max0.083-0.080=0.003
cache=y
dps=1
iters=10
policies=100
mean26.711-26.712=-0.001
σ0.874-0.645=0.230
min26.206-26.209=-0.004
max28.711-27.467=1.244
mean3989.000-3941.000=48.000
σ0.000
min3989.000-3941.000=48.000
max3989.000-3941.000=48.000
mean0.059-0.060=-0.001
σ0.002-0.000=0.002
min0.057-0.059=-0.003
max0.063-0.061=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.367-1756.368=-0.001
σ0.372-0.372=0.000
min1755.793-1755.797=-0.004
max1756.958-1756.971=-0.013
mean1656.100-1659.850=-3.750
σ626.464-627.447=-0.983
min684.000-612.000=72.000
max2603.000-2632.000=-29.000
mean2.271-2.333=-0.062
σ0.136-0.216=-0.080
min2.147-2.156=-0.009
max2.753-2.810=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.697-278.697=-0.000
σ0.014-0.014=0.001
min278.681-278.683=-0.002
max278.718-278.719=-0.001
mean2603.000-2632.000=-29.000
σ0.000
min2603.000-2632.000=-29.000
max2603.000-2632.000=-29.000
mean0.418-0.421=-0.003
σ0.002-0.002=-0.001
min0.416-0.419=-0.003
max0.421-0.424=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2268.868-2268.871=-0.003
σ0.003-0.010=-0.007
min2268.863-2268.856=0.007
max2268.870-2268.879=-0.010
mean2603.000-2632.000=-29.000
σ0.000
min2603.000-2632.000=-29.000
max2603.000-2632.000=-29.000
mean2.974-3.027=-0.053
σ0.079-0.194=-0.115
min2.921-2.878=0.043
max3.113-3.368=-0.255
iters=5
new-facts=6402
prior-facts=1
mean4952.351-4952.251=0.100
σ0.848-0.875=-0.026
min4951.900-4951.425=0.475
max4953.866-4953.743=0.122
mean2603.000-2632.000=-29.000
σ0.000
min2603.000-2632.000=-29.000
max2603.000-2632.000=-29.000
mean8.007-7.962=0.046
σ0.258-0.103=0.154
min7.673-7.809=-0.136
max8.319-8.079=0.239
iters=5
new-facts=6402
prior-facts=6402
mean5167.005-5166.871=0.134
σ0.150-0.314=-0.164
min5166.737-5166.373=0.365
max5167.076-5167.085=-0.009
mean3382.200-3347.800=34.400
σ481.887-451.569=30.318
min2725.000-2734.000=-9.000
max3989.000-3941.000=48.000
mean9.350-9.705=-0.355
σ0.275-0.527=-0.252
min8.931-9.107=-0.176
max9.591-10.329=-0.738

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.055=-0.052
σ0.138-0.124=0.014
min0.935-0.943=-0.009
max1.250-1.246=0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.258-460.256=0.002
σ572.608-572.607=0.001
min173.952-173.951=0.001
max1319.171-1319.166=0.005
mean79.500
σ7.000
min76.000
max90.000
mean435.000-438.000=-3.000
σ0.000
min435.000-438.000=-3.000
max435.000-438.000=-3.000
mean0.557-0.572=-0.015
σ0.566-0.591=-0.025
min0.267-0.269=-0.002
max1.406-1.458=-0.052
policies=20
mean1740.046-1740.024=0.022
σ0.333-0.341=-0.007
min1739.803-1739.777=0.026
max1740.535-1740.523=0.012
mean760.000
σ0.000
min760.000
max760.000
mean444.750-447.750=-3.000
σ9.605
min435.000-438.000=-3.000
max453.000-456.000=-3.000
mean2.655-2.674=-0.019
σ0.010-0.016=-0.005
min2.648-2.660=-0.012
max2.671-2.689=-0.018
policies=200
mean17409.677-17409.711=-0.035
σ0.045-0.145=-0.100
min17409.628-17409.540=0.088
max17409.733-17409.853=-0.120
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.250-491.500=-1.250
σ2.986-1.915=1.071
min487.000-490.000=-3.000
max494.000
mean26.908-26.929=-0.021
σ0.108-0.084=0.023
min26.773-26.812=-0.038
max27.030-26.995=0.035