Compare commits

Home / Compare d50fb73f .. 9c8b3de9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-35.617=-1.639
σ0.051-0.056=-0.005
min33.941-35.591=-1.650
max34.120-35.776=-1.657
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.082-0.083=-0.001
σ0.005-0.005=-0.001
min0.076-0.076=0.000
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-24.046=-0.728
σ0.003-0.003=0.000
min23.314-24.042=-0.728
max23.326-24.051=-0.725
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.065-0.067=-0.002
σ0.003-0.005=-0.002
min0.063-0.060=0.002
max0.072-0.074=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1718.563=38.739
σ0.365-169.703=-169.338
min1756.731-997.577=759.154
max1757.891-1757.080=0.811
mean1666.600-1593.350=73.250
σ627.958-603.188=24.770
min672.000-629.000=43.000
max2615.000-2429.000=186.000
mean2.369-2.263=0.106
σ0.072-0.218=-0.146
min2.287-1.397=0.891
max2.566-2.444=0.122

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.454-324.766=1.687
σ0.027-0.050=-0.023
min326.406-324.678=1.729
max326.471-324.795=1.676
mean2615.000-2429.000=186.000
σ0.000
min2615.000-2429.000=186.000
max2615.000-2429.000=186.000
mean0.422-0.431=-0.008
σ0.001-0.012=-0.011
min0.421-0.421=0.000
max0.424-0.448=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1988.616-1985.319=3.297
σ0.012-0.013=-0.001
min1988.598-1985.305=3.293
max1988.630-1985.334=3.297
mean2615.000-2429.000=186.000
σ0.000
min2615.000-2429.000=186.000
max2615.000-2429.000=186.000
mean2.717-2.624=0.092
σ0.106-0.096=0.010
min2.640-2.535=0.105
max2.889-2.739=0.150
iters=5
new-facts=6402
prior-facts=1
mean4813.328-4808.980=4.348
σ7.758-7.745=0.013
min4809.407-4805.008=4.399
max4827.198-4822.824=4.374
mean2615.000-2429.000=186.000
σ0.000
min2615.000-2429.000=186.000
max2615.000-2429.000=186.000
mean8.669-8.930=-0.261
σ0.332-0.424=-0.092
min8.188-8.587=-0.398
max9.123-9.613=-0.490
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-4996.632=4.379
σ0.023-0.013=0.010
min5000.983-4996.614=4.369
max5001.033-4996.646=4.387
mean3010.000-2995.400=14.600
σ293.102-324.019=-30.917
min2615.000-2571.000=44.000
max3386.000-3408.000=-22.000
mean9.769-8.612=1.157
σ0.152-0.108=0.044
min9.584-8.491=1.093
max10.004-8.716=1.288

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.132-1.629=-0.498
σ0.292-0.245=0.048
min0.918-1.198=-0.280
max1.552-1.791=-0.239

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.442-463.203=1.239
σ574.784-574.763=0.021
min177.040-175.816=1.224
max1326.618-1325.346=1.271
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2615.000-2429.000=186.000
σ0.000
min2615.000-2429.000=186.000
max2615.000-2429.000=186.000
mean0.548-0.542=0.007
σ0.546-0.545=0.001
min0.271-0.266=0.006
max1.368-1.359=0.009
policies=20
mean1770.762-1758.496=12.267
σ0.358-0.348=0.010
min1770.522-1758.258=12.264
max1771.294-1759.010=12.284
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2615.000-2429.000=186.000
σ0.000
min2615.000-2429.000=186.000
max2615.000-2429.000=186.000
mean2.737-2.701=0.035
σ0.025-0.013=0.013
min2.711-2.685=0.026
max2.768-2.715=0.054
policies=200
mean17714.912-17592.001=122.911
σ0.474-0.615=-0.142
min17714.657-17591.648=123.010
max17715.622-17592.922=122.700
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2615.000-2429.000=186.000
σ0.000
min2615.000-2429.000=186.000
max2615.000-2429.000=186.000
mean27.511-27.299=0.212
σ0.082-0.133=-0.051
min27.424-27.158=0.266
max27.611-27.474=0.137