Compare commits

Home / Compare 54ded9d9 .. 277cd424

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-35.618=-1.640
σ0.051-0.055=-0.004
min33.941-35.587=-1.646
max34.120-35.772=-1.653
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.082-0.085=-0.003
σ0.005-0.003=0.001
min0.076-0.083=-0.006
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-24.046=-0.728
σ0.003-0.003=0.000
min23.314-24.042=-0.728
max23.326-24.052=-0.726
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.066=-0.001
σ0.003-0.004=-0.001
min0.063-0.061=0.002
max0.072-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1756.492=0.811
σ0.365-0.366=-0.001
min1756.731-1755.917=0.814
max1757.891-1757.085=0.805
mean1666.600-1649.250=17.350
σ627.958-641.647=-13.689
min672.000-633.000=39.000
max2615.000-2832.000=-217.000
mean2.369-2.363=0.006
σ0.072-0.159=-0.087
min2.287-2.260=0.028
max2.566-2.996=-0.430

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.454-324.761=1.692
σ0.027-0.056=-0.029
min326.406-324.662=1.744
max326.471-324.794=1.677
mean2615.000-2832.000=-217.000
σ0.000
min2615.000-2832.000=-217.000
max2615.000-2832.000=-217.000
mean0.422-0.427=-0.005
σ0.001-0.010=-0.009
min0.421-0.421=0.000
max0.424-0.445=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1988.616-1985.316=3.300
σ0.012-0.021=-0.009
min1988.598-1985.284=3.315
max1988.630-1985.334=3.296
mean2615.000-2832.000=-217.000
σ0.000
min2615.000-2832.000=-217.000
max2615.000-2832.000=-217.000
mean2.717-2.630=0.086
σ0.106-0.108=-0.002
min2.640-2.517=0.123
max2.889-2.754=0.135
iters=5
new-facts=6402
prior-facts=1
mean4813.328-4809.085=4.243
σ7.758-7.737=0.022
min4809.407-4805.607=3.800
max4827.198-4822.925=4.274
mean2615.000-2832.000=-217.000
σ0.000
min2615.000-2832.000=-217.000
max2615.000-2832.000=-217.000
mean8.669-8.930=-0.261
σ0.332-0.340=-0.008
min8.188-8.383=-0.194
max9.123-9.291=-0.167
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-4996.549=4.461
σ0.023-0.156=-0.133
min5000.983-4996.273=4.710
max5001.033-4996.650=4.383
mean3010.000-3058.400=-48.400
σ293.102-307.030=-13.928
min2615.000-2832.000=-217.000
max3386.000-3535.000=-149.000
mean9.769-8.515=1.254
σ0.152-0.106=0.046
min9.584-8.412=1.172
max10.004-8.695=1.309

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.132-1.011=0.121
σ0.292-0.142=0.151
min0.918-0.918=-0.000
max1.552-1.244=0.308

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.442-463.216=1.226
σ574.784-574.771=0.013
min177.040-175.815=1.225
max1326.618-1325.372=1.245
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2615.000-2832.000=-217.000
σ0.000
min2615.000-2832.000=-217.000
max2615.000-2832.000=-217.000
mean0.548-0.428=0.121
σ0.546-0.299=0.247
min0.271-0.276=-0.004
max1.368-0.876=0.491
policies=20
mean1770.762-1758.523=12.239
σ0.358-0.361=-0.002
min1770.522-1758.280=12.243
max1771.294-1759.058=12.236
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2615.000-2832.000=-217.000
σ0.000
min2615.000-2832.000=-217.000
max2615.000-2832.000=-217.000
mean2.737-2.777=-0.040
σ0.025-0.008=0.017
min2.711-2.767=-0.056
max2.768-2.787=-0.018
policies=200
mean17714.912-17592.198=122.714
σ0.474-0.431=0.042
min17714.657-17591.896=122.761
max17715.622-17592.838=122.784
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2615.000-2832.000=-217.000
σ0.000
min2615.000-2832.000=-217.000
max2615.000-2832.000=-217.000
mean27.511-27.749=-0.238
σ0.082-0.353=-0.271
min27.424-27.451=-0.027
max27.611-28.182=-0.571