Compare commits

Home / Compare ea48be1c .. 495f4360

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.986-35.618=-1.633
σ0.049-0.054=-0.005
min33.955-35.590=-1.634
max34.123-35.770=-1.647
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.084-0.083=0.001
σ0.003-0.004=-0.001
min0.081-0.077=0.004
max0.090-0.090=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.324-24.048=-0.724
σ0.003-0.003=-0.000
min23.321-24.042=-0.721
max23.331-24.053=-0.722
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.063-0.069=-0.007
σ0.004-0.004=0.000
min0.060-0.066=-0.006
max0.069-0.075=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.299-1756.491=0.808
σ0.365-0.366=-0.001
min1756.725-1755.914=0.811
max1757.884-1757.081=0.803
mean1650.500-1652.850=-2.350
σ638.739-645.961=-7.223
min618.000-632.000=-14.000
max2757.000-2844.000=-87.000
mean2.377-2.323=0.055
σ0.102-0.072=0.030
min2.271-2.245=0.026
max2.625-2.524=0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.442-324.761=1.681
σ0.049-0.056=-0.007
min326.355-324.663=1.692
max326.476-324.797=1.679
mean2757.000-2844.000=-87.000
σ0.000
min2757.000-2844.000=-87.000
max2757.000-2844.000=-87.000
mean0.427-0.418=0.008
σ0.002-0.005=-0.003
min0.424-0.414=0.011
max0.429-0.426=0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.606-1985.331=3.276
σ0.011-0.007=0.004
min1988.595-1985.323=3.272
max1988.619-1985.340=3.279
mean2757.000-2844.000=-87.000
σ0.000
min2757.000-2844.000=-87.000
max2757.000-2844.000=-87.000
mean2.749-2.582=0.166
σ0.109-0.064=0.045
min2.631-2.533=0.098
max2.894-2.672=0.223
iters=5
new-facts=6402
prior-facts=1
mean4812.375-4809.111=3.264
σ7.734-7.673=0.060
min4808.833-4805.543=3.289
max4826.209-4822.837=3.372
mean2757.000-2844.000=-87.000
σ0.000
min2757.000-2844.000=-87.000
max2757.000-2844.000=-87.000
mean8.541-8.895=-0.354
σ0.489-0.451=0.039
min7.843-8.273=-0.430
max9.211-9.340=-0.129
iters=5
new-facts=6402
prior-facts=6402
mean4999.795-4996.491=3.304
σ0.315-0.195=0.120
min4999.237-4996.258=2.979
max4999.996-4996.652=3.345
mean2996.400-3059.000=-62.600
σ296.086-204.049=92.037
min2757.000-2844.000=-87.000
max3440.000-3358.000=82.000
mean9.341-8.629=0.712
σ0.756-0.188=0.568
min8.521-8.466=0.055
max10.168-8.895=1.273

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-0.945=0.062
σ0.066-0.059=0.007
min0.921-0.908=0.013
max1.058-1.047=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.432-463.207=1.226
σ574.772-574.768=0.004
min177.034-175.821=1.213
max1326.591-1325.359=1.232
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2757.000-2844.000=-87.000
σ0.000
min2757.000-2844.000=-87.000
max2757.000-2844.000=-87.000
mean0.436-0.428=0.008
σ0.308-0.302=0.005
min0.280-0.269=0.011
max0.898-0.881=0.017
policies=20
mean1770.690-1758.535=12.155
σ0.377-0.346=0.031
min1770.443-1758.313=12.130
max1771.250-1759.049=12.201
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2757.000-2844.000=-87.000
σ0.000
min2757.000-2844.000=-87.000
max2757.000-2844.000=-87.000
mean2.822-2.784=0.038
σ0.058-0.007=0.050
min2.788-2.774=0.014
max2.908-2.792=0.117
policies=200
mean17713.692-17592.226=121.465
σ0.495-0.452=0.043
min17713.349-17591.966=121.383
max17714.423-17592.903=121.520
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2757.000-2844.000=-87.000
σ0.000
min2757.000-2844.000=-87.000
max2757.000-2844.000=-87.000
mean27.554-27.825=-0.270
σ0.120-0.272=-0.152
min27.398-27.586=-0.188
max27.680-28.149=-0.470