Compare commits

Home / Compare 616e23cb .. 5b82b8dc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=0.000
σ0.049-0.048=0.001
min33.951-33.950=0.001
max34.113-34.112=0.001
mean416.900-414.000=2.900
σ0.316-0.000=0.316
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.082-0.081=0.002
σ0.005-0.004=0.000
min0.076-0.075=0.001
max0.090-0.089=0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.000
σ0.003-0.003=-0.001
min23.312-23.311=0.001
max23.320-23.324=-0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.065-0.064=0.001
σ0.003-0.001=0.002
min0.063-0.064=-0.001
max0.073-0.066=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.430=-0.002
σ0.365-0.365=0.001
min1756.853-1756.854=-0.001
max1758.020-1758.021=-0.001
mean1648.850-1646.850=2.000
σ625.003-625.007=-0.004
min638.000-637.000=1.000
max2838.000-2835.000=3.000
mean2.344-2.348=-0.004
σ0.093-0.088=0.005
min2.247-2.209=0.038
max2.624-2.595=0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.577-326.587=-0.010
σ0.046-0.024=0.022
min326.496-326.547=-0.051
max326.606-326.608=-0.002
mean2838.000-2835.000=3.000
σ0.000
min2838.000-2835.000=3.000
max2838.000-2835.000=3.000
mean0.423-0.427=-0.005
σ0.001-0.006=-0.004
min0.420-0.422=-0.002
max0.424-0.434=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.740-1988.740=0.001
σ0.008-0.015=-0.007
min1988.728-1988.715=0.013
max1988.749-1988.752=-0.003
mean2838.000-2835.000=3.000
σ0.000
min2838.000-2835.000=3.000
max2838.000-2835.000=3.000
mean2.717-2.700=0.016
σ0.102-0.159=-0.056
min2.638-2.566=0.072
max2.853-2.965=-0.112
iters=5
new-facts=6402
prior-facts=1
mean4813.475-4813.474=0.001
σ7.773-7.800=-0.027
min4809.666-4809.583=0.083
max4827.375-4827.421=-0.046
mean2838.000-2835.000=3.000
σ0.000
min2838.000-2835.000=3.000
max2838.000-2835.000=3.000
mean8.937-8.943=-0.007
σ0.423-0.294=0.129
min8.586-8.515=0.071
max9.622-9.228=0.394
iters=5
new-facts=6402
prior-facts=6402
mean4820.965-5001.067=-180.102
σ402.894-0.166=402.728
min4100.246-5000.770=-900.524
max5001.156-5001.153=0.003
mean2989.000-3001.600=-12.600
σ232.222-188.309=43.913
min2838.000-2835.000=3.000
max3365.000-3294.000=71.000
mean9.314-9.571=-0.258
σ0.885-0.619=0.266
min7.738-8.475=-0.736
max9.792-9.940=-0.148

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.016-1.027=-0.011
σ0.166-0.169=-0.003
min0.911-0.911=0.000
max1.295-1.310=-0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.563-464.572=-0.009
σ574.774-574.770=0.004
min177.174-177.174=0.000
max1326.723-1326.727=-0.004
mean88.250
σ8.500
min84.000
max101.000
mean2838.000-2835.000=3.000
σ0.000
min2838.000-2835.000=3.000
max2838.000-2835.000=3.000
mean0.437-0.437=0.000
σ0.306-0.307=-0.001
min0.280-0.281=-0.001
max0.896-0.897=-0.001
policies=20
mean1772.036-1772.059=-0.023
σ0.344-0.368=-0.024
min1771.816-1771.808=0.008
max1772.550-1772.603=-0.054
mean840.000
σ0.000
min840.000
max840.000
mean2838.000-2835.000=3.000
σ0.000
min2838.000-2835.000=3.000
max2838.000-2835.000=3.000
mean2.781-2.792=-0.011
σ0.026-0.010=0.017
min2.744-2.781=-0.037
max2.807-2.805=0.002
policies=200
mean17727.374-17727.659=-0.284
σ0.563-0.417=0.146
min17727.010-17727.360=-0.350
max17728.214-17728.275=-0.062
mean8400.000
σ0.000
min8400.000
max8400.000
mean2838.000-2835.000=3.000
σ0.000
min2838.000-2835.000=3.000
max2838.000-2835.000=3.000
mean27.768-27.863=-0.095
σ0.413-0.435=-0.022
min27.393-27.470=-0.078
max28.239-28.316=-0.077