Compare commits

Home / Compare 78e37ecb .. 1f969a64

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.707-53.709=-0.001
σ0.363-0.365=-0.002
min53.574-53.569=0.005
max54.738-54.745=-0.007
mean415.000-418.800=-3.800
σ0.000-0.422=-0.422
min415.000-418.000=-3.000
max415.000-419.000=-4.000
mean0.135-0.136=-0.001
σ0.004-0.004=-0.000
min0.129-0.130=-0.000
max0.141-0.144=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.978-42.978=0.000
σ0.005-0.006=-0.000
min42.971-42.966=0.005
max42.989-42.987=0.002
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.118-0.119=-0.002
σ0.004-0.005=-0.001
min0.112-0.112=0.001
max0.124-0.128=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.217-995.224=-0.006
σ1.189-1.173=0.015
min994.688-994.664=0.024
max1000.209-1000.146=0.063
mean1055.800-1067.000=-11.200
σ311.801-319.679=-7.878
min593.000-597.000=-4.000
max1513.000-1594.000=-81.000
mean1.489-1.464=0.026
σ0.136-0.073=0.063
min1.384-1.386=-0.002
max2.007-1.652=0.355

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.306-297.321=-0.015
σ0.019-0.010=0.009
min297.273-297.312=-0.039
max297.324-297.339=-0.015
mean1513.000-1594.000=-81.000
σ0.000
min1513.000-1594.000=-81.000
max1513.000-1594.000=-81.000
mean0.390-0.391=-0.002
σ0.001-0.005=-0.004
min0.388-0.387=0.001
max0.391-0.399=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1299.011-1299.007=0.003
σ0.093-0.091=0.002
min1298.844-1298.846=-0.002
max1299.064-1299.064=-0.000
mean1513.000-1594.000=-81.000
σ0.000
min1513.000-1594.000=-81.000
max1513.000-1594.000=-81.000
mean1.870-2.053=-0.182
σ0.055-0.268=-0.213
min1.844-1.839=0.005
max1.969-2.485=-0.516
iters=5
new-facts=6402
prior-facts=1
mean1719.180-1719.187=-0.007
σ6.925-6.898=0.027
min1715.989-1716.000=-0.011
max1731.566-1731.525=0.041
mean1513.000-1594.000=-81.000
σ0.000
min1513.000-1594.000=-81.000
max1513.000-1594.000=-81.000
mean2.906-2.983=-0.077
σ0.417-0.307=0.111
min2.599-2.688=-0.089
max3.624-3.424=0.200
iters=5
new-facts=6402
prior-facts=6402
mean1981.920-1981.924=-0.004
σ0.033-0.045=-0.012
min1981.863-1981.856=0.007
max1981.943-1981.980=-0.037
mean1793.800-1813.400=-19.600
σ234.260-217.860=16.400
min1522.000-1594.000=-72.000
max2121.000-2132.000=-11.000
mean3.343-3.297=0.046
σ0.363-0.430=-0.066
min3.105-3.003=0.103
max3.988-4.053=-0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.533-1.361=0.172
σ0.303-0.285=0.018
min1.179-1.039=0.140
max1.761-1.752=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.450-440.462=-0.012
σ573.029-573.041=-0.012
min153.929-153.937=-0.008
max1299.993-1300.024=-0.031
mean94.250
σ8.500
min90.000
max107.000
mean1513.000-1594.000=-81.000
σ0.000
min1513.000-1594.000=-81.000
max1513.000-1594.000=-81.000
mean0.523-0.557=-0.034
σ0.529-0.577=-0.048
min0.258-0.266=-0.008
max1.317-1.423=-0.106
policies=20
mean1539.559-1539.582=-0.023
σ0.322-0.316=0.005
min1539.351-1539.378=-0.027
max1540.037-1540.053=-0.016
mean900.000
σ0.000
min900.000
max900.000
mean1513.000-1594.000=-81.000
σ0.000
min1513.000-1594.000=-81.000
max1513.000-1594.000=-81.000
mean2.591-2.586=0.004
σ0.027-0.016=0.010
min2.555-2.563=-0.008
max2.615-2.599=0.016
policies=200
mean15403.715-15403.768=-0.053
σ0.075-0.080=-0.006
min15403.641-15403.651=-0.010
max15403.787-15403.830=-0.043
mean9000.000
σ0.000
min9000.000
max9000.000
mean1513.000-1594.000=-81.000
σ0.000
min1513.000-1594.000=-81.000
max1513.000-1594.000=-81.000
mean26.136-26.004=0.132
σ0.205-0.169=0.036
min25.896-25.865=0.031
max26.384-26.214=0.170