Compare commits

Home / Compare b77ddba8 .. 29241d19

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-35.618=-1.640
σ0.051-0.053=-0.001
min33.941-35.593=-1.652
max34.120-35.766=-1.647
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.082-0.087=-0.005
σ0.005-0.004=0.001
min0.076-0.083=-0.007
max0.090-0.093=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-24.047=-0.729
σ0.003-0.004=-0.001
min23.314-24.042=-0.729
max23.326-24.053=-0.727
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.065-0.068=-0.003
σ0.003-0.005=-0.003
min0.063-0.062=0.001
max0.072-0.076=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1756.490=0.813
σ0.365-0.365=0.000
min1756.731-1755.914=0.818
max1757.891-1757.085=0.806
mean1666.600-1640.650=25.950
σ627.958-642.004=-14.046
min672.000-629.000=43.000
max2615.000-2876.000=-261.000
mean2.369-2.360=0.009
σ0.072-0.099=-0.027
min2.287-2.263=0.025
max2.566-2.614=-0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.454-324.773=1.680
σ0.027-0.040=-0.013
min326.406-324.706=1.701
max326.471-324.811=1.661
mean2615.000-2876.000=-261.000
σ0.000
min2615.000-2876.000=-261.000
max2615.000-2876.000=-261.000
mean0.422-0.424=-0.002
σ0.001-0.011=-0.010
min0.421-0.414=0.007
max0.424-0.439=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.616-1985.320=3.296
σ0.012-0.012=-0.000
min1988.598-1985.308=3.290
max1988.630-1985.334=3.296
mean2615.000-2876.000=-261.000
σ0.000
min2615.000-2876.000=-261.000
max2615.000-2876.000=-261.000
mean2.717-2.699=0.018
σ0.106-0.267=-0.162
min2.640-2.470=0.170
max2.889-3.149=-0.260
iters=5
new-facts=6402
prior-facts=1
mean4813.328-4809.108=4.220
σ7.758-7.749=0.010
min4809.407-4805.614=3.793
max4827.198-4822.970=4.229
mean2615.000-2876.000=-261.000
σ0.000
min2615.000-2876.000=-261.000
max2615.000-2876.000=-261.000
mean8.669-9.103=-0.434
σ0.332-0.203=0.128
min8.188-8.908=-0.719
max9.123-9.345=-0.221
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-4996.629=4.381
σ0.023-0.024=-0.001
min5000.983-4996.602=4.381
max5001.033-4996.657=4.376
mean3010.000-3086.400=-76.400
σ293.102-295.573=-2.471
min2615.000-2876.000=-261.000
max3386.000-3551.000=-165.000
mean9.769-8.605=1.164
σ0.152-0.284=-0.132
min9.584-8.369=1.215
max10.004-9.097=0.907

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.132-0.986=0.146
σ0.292-0.147=0.146
min0.918-0.912=0.006
max1.552-1.247=0.305

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.442-463.217=1.225
σ574.784-574.771=0.013
min177.040-175.819=1.221
max1326.618-1325.373=1.244
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2615.000-2876.000=-261.000
σ0.000
min2615.000-2876.000=-261.000
max2615.000-2876.000=-261.000
mean0.548-0.427=0.121
σ0.546-0.300=0.246
min0.271-0.274=-0.003
max1.368-0.877=0.491
policies=20
mean1770.762-1758.533=12.229
σ0.358-0.356=0.002
min1770.522-1758.295=12.228
max1771.294-1759.061=12.233
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2615.000-2876.000=-261.000
σ0.000
min2615.000-2876.000=-261.000
max2615.000-2876.000=-261.000
mean2.737-2.785=-0.048
σ0.025-0.003=0.022
min2.711-2.780=-0.069
max2.768-2.786=-0.018
policies=200
mean17714.912-17592.202=122.710
σ0.474-0.453=0.020
min17714.657-17591.857=122.801
max17715.622-17592.867=122.755
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2615.000-2876.000=-261.000
σ0.000
min2615.000-2876.000=-261.000
max2615.000-2876.000=-261.000
mean27.511-27.906=-0.395
σ0.082-0.520=-0.437
min27.424-27.449=-0.024
max27.611-28.591=-0.980