Compare commits

Home / Compare 3eef2974 .. a7f7574b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.619=-0.000
σ0.049-0.050=-0.000
min35.587-35.583=0.004
max35.755-35.755=0.000
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.085-0.085=-0.000
σ0.003-0.005=-0.002
min0.082-0.078=0.005
max0.089-0.094=-0.005
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.000
σ0.004-0.002=0.002
min24.040-24.043=-0.003
max24.053-24.050=0.003
mean412.700-418.000=-5.300
σ0.483-0.000=0.483
min412.000-418.000=-6.000
max413.000-418.000=-5.000
mean0.068-0.066=0.002
σ0.003-0.003=0.001
min0.062-0.061=0.001
max0.074-0.068=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.063-1757.062=0.001
σ0.366-0.364=0.002
min1756.492-1756.489=0.003
max1757.655-1757.648=0.007
mean1647.450-1650.000=-2.550
σ628.793-623.394=5.399
min636.000-640.000=-4.000
max2835.000-2828.000=7.000
mean2.347-2.363=-0.016
σ0.081-0.066=0.015
min2.248-2.272=-0.024
max2.601-2.522=0.079

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.889-325.895=-0.006
σ0.052-0.040=0.012
min325.799-325.826=-0.027
max325.927-325.926=0.002
mean2835.000-2828.000=7.000
σ0.000
min2835.000-2828.000=7.000
max2835.000-2828.000=7.000
mean0.426-0.431=-0.005
σ0.007-0.007=-0.001
min0.419-0.425=-0.006
max0.437-0.441=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1988.065-1988.062=0.004
σ0.010-0.008=0.002
min1988.054-1988.051=0.003
max1988.079-1988.071=0.008
mean2835.000-2828.000=7.000
σ0.000
min2835.000-2828.000=7.000
max2835.000-2828.000=7.000
mean2.650-2.630=0.020
σ0.099-0.115=-0.016
min2.563-2.481=0.082
max2.816-2.774=0.042
iters=5
new-facts=6402
prior-facts=1
mean4811.883-4811.848=0.035
σ7.711-7.662=0.049
min4808.273-4808.319=-0.046
max4825.674-4825.553=0.121
mean2835.000-2828.000=7.000
σ0.000
min2835.000-2828.000=7.000
max2835.000-2828.000=7.000
mean8.329-8.515=-0.186
σ0.744-0.414=0.330
min7.698-7.807=-0.109
max9.231-8.861=0.369
iters=5
new-facts=6402
prior-facts=6402
mean4999.169-4999.381=-0.212
σ0.202-0.016=0.187
min4998.998-4999.360=-0.363
max4999.399-4999.403=-0.004
mean3038.000-3037.600=0.400
σ253.026-210.851=42.174
min2835.000-2828.000=7.000
max3412.000-3322.000=90.000
mean9.695-9.790=-0.095
σ0.263-0.407=-0.144
min9.270-9.427=-0.157
max9.987-10.439=-0.452

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.921-0.984=-0.063
σ0.012-0.132=-0.120
min0.912-0.913=-0.002
max0.942-1.219=-0.277

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.263-464.262=0.001
σ574.772-574.772=0.000
min176.873-176.868=0.004
max1326.422-1326.421=0.001
mean88.250
σ8.500
min84.000
max101.000
mean2835.000-2828.000=7.000
σ0.000
min2835.000-2828.000=7.000
max2835.000-2828.000=7.000
mean0.432-0.438=-0.005
σ0.303-0.302=0.001
min0.279-0.285=-0.006
max0.887-0.891=-0.004
policies=20
mean1769.073-1769.051=0.022
σ0.355-0.362=-0.007
min1768.844-1768.789=0.056
max1769.600-1769.581=0.019
mean840.000
σ0.000
min840.000
max840.000
mean2835.000-2828.000=7.000
σ0.000
min2835.000-2828.000=7.000
max2835.000-2828.000=7.000
mean2.801-2.836=-0.036
σ0.004-0.025=-0.021
min2.796-2.816=-0.021
max2.803-2.872=-0.069
policies=200
mean17697.522-17697.562=-0.040
σ0.537-0.496=0.042
min17697.107-17697.173=-0.066
max17698.312-17698.280=0.032
mean8400.000
σ0.000
min8400.000
max8400.000
mean2835.000-2828.000=7.000
σ0.000
min2835.000-2828.000=7.000
max2835.000-2828.000=7.000
mean28.047-28.138=-0.090
σ0.321-0.406=-0.086
min27.692-27.785=-0.093
max28.384-28.543=-0.159