Compare commits

Home / Compare 9083c29d .. afae6508

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.728-36.728=0.000
σ0.615-1.333=-0.718
min35.927-35.921=0.006
max37.218-39.695=-2.476
mean4097.000-3989.000=108.000
σ0.000
min4097.000-3989.000=108.000
max4097.000-3989.000=108.000
mean0.074-0.076=-0.002
σ0.001-0.003=-0.002
min0.071-0.074=-0.003
max0.076-0.083=-0.007
cache=y
dps=1
iters=10
policies=100
mean26.711-26.711=0.000
σ0.646-0.874=-0.228
min26.204-26.206=-0.001
max27.466-28.711=-1.245
mean4097.000-3989.000=108.000
σ0.000
min4097.000-3989.000=108.000
max4097.000-3989.000=108.000
mean0.060-0.059=0.001
σ0.001-0.002=-0.002
min0.059-0.057=0.002
max0.061-0.063=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.369-1756.367=0.002
σ0.374-0.372=0.001
min1755.789-1755.793=-0.004
max1756.970-1756.958=0.012
mean1665.600-1656.100=9.500
σ632.275-626.464=5.811
min686.000-684.000=2.000
max2618.000-2603.000=15.000
mean2.297-2.271=0.027
σ0.146-0.136=0.010
min2.175-2.147=0.028
max2.807-2.753=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.696-278.697=-0.001
σ0.014-0.014=-0.001
min278.681-278.681=-0.000
max278.716-278.718=-0.002
mean2618.000-2603.000=15.000
σ0.000
min2618.000-2603.000=15.000
max2618.000-2603.000=15.000
mean0.417-0.418=-0.001
σ0.001-0.002=-0.001
min0.416-0.416=-0.000
max0.418-0.421=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.867-2268.868=-0.000
σ0.013-0.003=0.010
min2268.844-2268.863=-0.019
max2268.878-2268.870=0.008
mean2618.000-2603.000=15.000
σ0.000
min2618.000-2603.000=15.000
max2618.000-2603.000=15.000
mean3.127-2.974=0.153
σ0.173-0.079=0.094
min2.866-2.921=-0.055
max3.307-3.113=0.194
iters=5
new-facts=6402
prior-facts=1
mean4952.367-4952.351=0.016
σ0.907-0.848=0.058
min4951.799-4951.900=-0.102
max4953.980-4953.866=0.114
mean2618.000-2603.000=15.000
σ0.000
min2618.000-2603.000=15.000
max2618.000-2603.000=15.000
mean8.012-8.007=0.004
σ0.442-0.258=0.184
min7.621-7.673=-0.052
max8.766-8.319=0.448
iters=5
new-facts=6402
prior-facts=6402
mean5167.072-5167.005=0.067
σ0.011-0.150=-0.139
min5167.060-5166.737=0.323
max5167.089-5167.076=0.013
mean3422.000-3382.200=39.800
σ463.099-481.887=-18.788
min2882.000-2725.000=157.000
max4097.000-3989.000=108.000
mean9.128-9.350=-0.222
σ0.098-0.275=-0.177
min9.027-8.931=0.096
max9.264-9.591=-0.327

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.038-1.003=0.035
σ0.139-0.138=0.001
min0.945-0.935=0.010
max1.265-1.250=0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.256-460.258=-0.002
σ572.608-572.608=-0.000
min173.949-173.952=-0.003
max1319.168-1319.171=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean437.000-435.000=2.000
σ0.000
min437.000-435.000=2.000
max437.000-435.000=2.000
mean0.554-0.557=-0.002
σ0.560-0.566=-0.006
min0.272-0.267=0.004
max1.394-1.406=-0.012
policies=20
mean1740.030-1740.046=-0.016
σ0.341-0.333=0.008
min1739.779-1739.803=-0.024
max1740.530-1740.535=-0.005
mean760.000
σ0.000
min760.000
max760.000
mean447.500-444.750=2.750
σ9.950-9.605=0.345
min437.000-435.000=2.000
max456.000-453.000=3.000
mean2.673-2.655=0.017
σ0.015-0.010=0.005
min2.658-2.648=0.010
max2.695-2.671=0.024
policies=200
mean17409.718-17409.677=0.041
σ0.153-0.045=0.107
min17409.562-17409.628=-0.065
max17409.879-17409.733=0.146
mean7600.000
σ0.000
min7600.000
max7600.000
mean493.750-490.250=3.500
σ3.775-2.986=0.789
min489.000-487.000=2.000
max498.000-494.000=4.000
mean26.993-26.908=0.084
σ0.077-0.108=-0.031
min26.922-26.773=0.149
max27.062-27.030=0.032