Compare commits

Home / Compare 588b744c .. e6940d01

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.655=-0.000
σ0.367-0.368=-0.002
min53.518-53.513=0.004
max54.698-54.703=-0.005
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.138-0.135=0.003
σ0.003-0.005=-0.002
min0.135-0.129=0.006
max0.142-0.141=0.001
cache=y
dps=1
iters=10
policies=100
mean42.979-42.983=-0.003
σ0.005-0.009=-0.004
min42.974-42.972=0.002
max42.990-43.001=-0.012
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.120-0.129=-0.009
σ0.004-0.008=-0.004
min0.114-0.119=-0.006
max0.126-0.139=-0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.974-1013.970=0.005
σ1.141-1.161=-0.021
min1013.393-1013.423=-0.030
max1018.735-1018.829=-0.094
mean1050.900-1048.900=2.000
σ317.504-316.664=0.840
min584.000
max1655.000-1653.000=2.000
mean1.580-1.612=-0.031
σ0.080-0.141=-0.061
min1.505-1.469=0.035
max1.828-2.107=-0.279

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.124-299.128=-0.004
σ0.230-0.247=-0.018
min298.862-298.984=-0.121
max299.630-299.804=-0.174
mean2048.000-2084.000=-36.000
σ0.000
min2048.000-2084.000=-36.000
max2048.000-2084.000=-36.000
mean0.578-0.582=-0.004
σ0.019-0.023=-0.004
min0.558-0.537=0.021
max0.600-0.601=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.676-294.681=-0.004
σ0.012-0.010=0.003
min294.656-294.670=-0.014
max294.688-294.696=-0.008
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean0.393-0.385=0.009
σ0.010-0.006=0.004
min0.383-0.379=0.004
max0.406-0.394=0.012
iters=5
new-facts=1
prior-facts=6402
mean1316.933-1316.944=-0.011
σ0.099-0.096=0.002
min1316.868-1316.894=-0.026
max1317.107-1317.116=-0.008
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean1.958-1.926=0.031
σ0.082-0.083=-0.001
min1.859-1.845=0.013
max2.064-2.042=0.022
iters=5
new-facts=6402
prior-facts=1
mean1555.290-1555.300=-0.010
σ6.870-6.841=0.029
min1552.011-1552.008=0.002
max1567.574-1567.532=0.042
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean2.270-2.290=-0.020
σ0.199-0.186=0.013
min2.142-2.084=0.058
max2.619-2.486=0.133
iters=5
new-facts=6402
prior-facts=6402
mean1884.775-1884.778=-0.003
σ0.045-0.028=0.018
min1884.734-1884.740=-0.005
max1884.853-1884.817=0.036
mean1785.000-1814.800=-29.800
σ166.236-189.232=-22.996
min1655.000-1653.000=2.000
max2048.000-2084.000=-36.000
mean2.956-2.932=0.024
σ0.074-0.146=-0.072
min2.904-2.765=0.139
max3.088-3.092=-0.004

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.216-1.176=0.040
σ0.276-0.387=-0.111
min1.010-0.909=0.101
max1.651-1.827=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.567-440.575=-0.008
σ573.039-573.037=0.002
min154.044-154.043=0.001
max1300.125-1300.130=-0.005
mean96.250
σ8.500
min92.000
max109.000
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean0.566-0.572=-0.006
σ0.591-0.606=-0.015
min0.269-0.268=0.001
max1.453-1.481=-0.028
policies=20
mean1540.676-1540.690=-0.014
σ0.302-0.312=-0.010
min1540.496-1540.507=-0.012
max1541.127-1541.157=-0.030
mean920.000
σ0.000
min920.000
max920.000
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean2.572-2.598=-0.027
σ0.012-0.042=-0.030
min2.563-2.566=-0.004
max2.589-2.659=-0.070
policies=200
mean15414.866-15414.774=0.091
σ0.089-0.035=0.055
min15414.803-15414.737=0.067
max15414.998-15414.804=0.194
mean9200.000
σ0.000
min9200.000
max9200.000
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean26.164-26.232=-0.069
σ0.124-0.217=-0.092
min26.005-26.000=0.005
max26.277-26.508=-0.230