Compare commits

Home / Compare b0f6e681 .. f2a04cfb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=-0.000
σ0.049-0.047=0.002
min33.953-33.948=0.005
max34.113-34.107=0.007
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.080-0.083=-0.003
σ0.004-0.003=0.001
min0.076-0.078=-0.001
max0.088-0.090=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.004=-0.001
min23.312-23.312=0.000
max23.320-23.323=-0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.063-0.064=-0.000
σ0.003-0.002=0.000
min0.061-0.057=0.003
max0.068-0.065=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.364-1719.414=37.950
σ0.364-169.651=-169.287
min1756.788-998.650=758.138
max1757.956-1757.962=-0.006
mean1647.500-1624.750=22.750
σ625.594-589.546=36.049
min637.000-635.000=2.000
max2835.000-2412.000=423.000
mean2.346-2.283=0.063
σ0.097-0.231=-0.134
min2.134-1.363=0.770
max2.615-2.595=0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.506-326.514=-0.008
σ0.054-0.031=0.023
min326.411-326.460=-0.049
max326.538-326.537=0.001
mean2835.000-2412.000=423.000
σ0.000
min2835.000-2412.000=423.000
max2835.000-2412.000=423.000
mean0.425-0.424=0.000
σ0.007-0.003=0.004
min0.419-0.420=-0.000
max0.435-0.429=0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.675-1988.673=0.002
σ0.016-0.016=0.000
min1988.648-1988.653=-0.005
max1988.689-1988.689=-0.000
mean2835.000-2412.000=423.000
σ0.000
min2835.000-2412.000=423.000
max2835.000-2412.000=423.000
mean2.664-2.727=-0.063
σ0.195-0.101=0.094
min2.390-2.634=-0.244
max2.927-2.853=0.073
iters=5
new-facts=6402
prior-facts=1
mean4813.517-4813.417=0.101
σ7.740-7.771=-0.031
min4810.009-4809.522=0.488
max4827.363-4827.310=0.053
mean2835.000-2412.000=423.000
σ0.000
min2835.000-2412.000=423.000
max2835.000-2412.000=423.000
mean8.753-8.483=0.270
σ0.365-0.437=-0.072
min8.399-8.023=0.376
max9.289-9.153=0.137
iters=5
new-facts=6402
prior-facts=6402
mean5001.080-5001.076=0.003
σ0.025-0.030=-0.005
min5001.059-5001.037=0.022
max5001.121-5001.110=0.011
mean3004.800-2942.200=62.600
σ190.202-435.228=-245.027
min2835.000-2459.000=376.000
max3298.000-3526.000=-228.000
mean9.897-9.565=0.332
σ0.242-0.628=-0.386
min9.601-8.496=1.105
max10.249-10.168=0.080

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.971-1.615=-0.644
σ0.067-0.288=-0.220
min0.912-1.130=-0.217
max1.053-1.893=-0.840

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.506-464.491=0.016
σ574.772-574.765=0.007
min177.109-177.103=0.006
max1326.665-1326.639=0.026
mean88.250
σ8.500
min84.000
max101.000
mean2835.000-2412.000=423.000
σ0.000
min2835.000-2412.000=423.000
max2835.000-2412.000=423.000
mean0.437-0.560=-0.123
σ0.306-0.565=-0.260
min0.280-0.276=0.004
max0.895-1.408=-0.513
policies=20
mean1771.406-1771.362=0.044
σ0.363-0.360=0.003
min1771.152-1771.123=0.029
max1771.942-1771.896=0.045
mean840.000
σ0.000
min840.000
max840.000
mean2835.000-2412.000=423.000
σ0.000
min2835.000-2412.000=423.000
max2835.000-2412.000=423.000
mean2.802-2.736=0.067
σ0.015-0.030=-0.015
min2.792-2.710=0.082
max2.824-2.762=0.062
policies=200
mean17721.119-17720.865=0.254
σ0.521-0.529=-0.008
min17720.742-17720.566=0.177
max17721.867-17721.655=0.212
mean8400.000
σ0.000
min8400.000
max8400.000
mean2835.000-2412.000=423.000
σ0.000
min2835.000-2412.000=423.000
max2835.000-2412.000=423.000
mean27.894-27.495=0.400
σ0.458-0.185=0.273
min27.512-27.305=0.207
max28.452-27.720=0.731