Compare commits

Home / Compare b83ead6f .. cdc6d3eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.992-35.974=0.017
σ0.108-0.107=0.001
min35.949-35.931=0.019
max36.297-36.278=0.019
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.076-0.077=-0.001
σ0.004-0.004=-0.000
min0.071-0.074=-0.003
max0.083-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.221-26.209=0.012
σ0.002-0.004=-0.002
min26.218-26.202=0.016
max26.225-26.215=0.010
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.058-0.061=-0.003
σ0.003-0.003=0.000
min0.056-0.059=-0.004
max0.064-0.069=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.712-1756.713=-0.001
σ0.369-0.370=-0.001
min1756.139-1756.140=-0.001
max1757.302-1757.309=-0.007
mean1636.100-1645.200=-9.100
σ635.326-615.131=20.195
min641.000-642.000=-1.000
max2844.000-2485.000=359.000
mean2.356-2.336=0.020
σ0.084-0.057=0.027
min2.266-2.273=-0.007
max2.557-2.484=0.074

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.883-277.886=-0.002
σ0.009-0.004=0.005
min277.869-277.882=-0.013
max277.893-277.893=-0.000
mean2844.000-2485.000=359.000
σ0.000
min2844.000-2485.000=359.000
max2844.000-2485.000=359.000
mean0.403-0.405=-0.002
σ0.004-0.007=-0.003
min0.399-0.398=0.001
max0.408-0.415=-0.007
iters=5
new-facts=1
prior-facts=6402
mean2176.825-2176.833=-0.009
σ0.020-0.004=0.016
min2176.797-2176.827=-0.031
max2176.841-2176.837=0.004
mean2844.000-2485.000=359.000
σ0.000
min2844.000-2485.000=359.000
max2844.000-2485.000=359.000
mean3.371-3.420=-0.049
σ0.186-0.281=-0.095
min3.093-3.001=0.092
max3.537-3.734=-0.198
iters=5
new-facts=6402
prior-facts=1
mean5054.581-5054.729=-0.148
σ1.039-0.919=0.120
min5053.638-5054.148=-0.510
max5056.360-5056.360=-0.000
mean2844.000-2485.000=359.000
σ0.000
min2844.000-2485.000=359.000
max2844.000-2485.000=359.000
mean8.862-8.768=0.094
σ0.417-0.638=-0.221
min8.265-7.888=0.377
max9.293-9.534=-0.242
iters=5
new-facts=6402
prior-facts=6402
mean5192.115-5192.127=-0.012
σ0.093-0.074=0.019
min5192.024-5192.056=-0.032
max5192.217-5192.210=0.007
mean3309.800-3250.200=59.600
σ372.739-415.665=-42.926
min2844.000-2648.000=196.000
max3677.000-3715.000=-38.000
mean8.826-8.855=-0.028
σ0.083-0.238=-0.155
min8.714-8.691=0.022
max8.897-9.266=-0.369

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.625=-0.623
σ0.075-0.286=-0.211
min0.933-1.138=-0.205
max1.087-1.824=-0.736

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.039-464.030=0.009
σ573.082-573.075=0.007
min177.493-177.490=0.002
max1323.662-1323.643=0.019
mean77.750
σ7.500
min74.000
max89.000
mean2844.000-2485.000=359.000
σ0.000
min2844.000-2485.000=359.000
max2844.000-2485.000=359.000
mean0.437-0.558=-0.121
σ0.302-0.563=-0.261
min0.281-0.275=0.007
max0.890-1.403=-0.512
policies=20
mean1775.210-1775.168=0.042
σ0.323-0.333=-0.010
min1774.998-1774.954=0.045
max1775.688-1775.664=0.023
mean740.000
σ0.000
min740.000
max740.000
mean2844.000-2485.000=359.000
σ0.000
min2844.000-2485.000=359.000
max2844.000-2485.000=359.000
mean2.829-2.742=0.087
σ0.010-0.017=-0.007
min2.817-2.721=0.096
max2.838-2.760=0.077
policies=200
mean17758.294-17758.071=0.224
σ0.432-0.558=-0.126
min17758.017-17757.736=0.281
max17758.936-17758.899=0.037
mean7400.000
σ0.000
min7400.000
max7400.000
mean2844.000-2485.000=359.000
σ0.000
min2844.000-2485.000=359.000
max2844.000-2485.000=359.000
mean28.150-27.586=0.563
σ0.579-0.100=0.479
min27.652-27.500=0.152
max28.792-27.713=1.079