Compare commits

Home / Compare 6fab71d7 .. 9429c8d8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.653-53.658=-0.005
σ0.365-0.369=-0.004
min53.519-53.522=-0.003
max54.692-54.708=-0.016
mean416.700-417.000=-0.300
σ0.483-0.000=0.483
min416.000-417.000=-1.000
max417.000
mean0.139-0.148=-0.010
σ0.004-0.011=-0.007
min0.135-0.136=-0.000
max0.146-0.162=-0.017
cache=y
dps=1
iters=10
policies=100
mean42.980-42.980=0.000
σ0.006-0.006=0.000
min42.973-42.972=0.002
max42.990-42.992=-0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.117-0.121=-0.004
σ0.002-0.003=-0.001
min0.113-0.117=-0.004
max0.122-0.128=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.968-1013.974=-0.006
σ1.176-1.171=0.004
min1013.425-1013.427=-0.002
max1018.887-1018.878=0.009
mean1052.050-1051.100=0.950
σ316.776-316.915=-0.139
min587.000-585.000=2.000
max1656.000-1655.000=1.000
mean1.643-1.642=0.001
σ0.080-0.085=-0.005
min1.574-1.542=0.032
max1.893-1.866=0.027

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.079-299.183=-0.105
σ0.186-0.225=-0.038
min298.858-299.048=-0.190
max299.543-299.803=-0.259
mean1976.000-2050.000=-74.000
σ0.000
min1976.000-2050.000=-74.000
max1976.000-2050.000=-74.000
mean0.621-0.580=0.041
σ0.030-0.023=0.007
min0.563-0.542=0.021
max0.683-0.617=0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.676-294.674=0.002
σ0.015-0.016=-0.001
min294.657-294.659=-0.002
max294.698-294.697=0.001
mean1656.000-1655.000=1.000
σ0.000
min1656.000-1655.000=1.000
max1656.000-1655.000=1.000
mean0.386-0.383=0.003
σ0.007-0.001=0.007
min0.381-0.382=-0.001
max0.399-0.384=0.015
iters=5
new-facts=1
prior-facts=6402
mean1316.946-1316.933=0.013
σ0.100-0.101=-0.001
min1316.896-1316.871=0.025
max1317.125-1317.111=0.014
mean1656.000-1655.000=1.000
σ0.000
min1656.000-1655.000=1.000
max1656.000-1655.000=1.000
mean1.931-1.941=-0.010
σ0.081-0.101=-0.020
min1.848-1.845=0.004
max2.028-2.098=-0.070
iters=5
new-facts=6402
prior-facts=1
mean1555.279-1555.281=-0.001
σ6.872-6.868=0.004
min1551.975-1551.955=0.020
max1567.566-1567.561=0.005
mean1656.000-1655.000=1.000
σ0.000
min1656.000-1655.000=1.000
max1656.000-1655.000=1.000
mean2.250-2.259=-0.008
σ0.222-0.197=0.025
min2.052-2.102=-0.050
max2.617-2.595=0.022
iters=5
new-facts=6402
prior-facts=6402
mean1884.765-1884.767=-0.003
σ0.029-0.019=0.010
min1884.727-1884.746=-0.019
max1884.808-1884.796=0.012
mean1807.000-1795.000=12.000
σ161.261-171.390=-10.129
min1656.000-1655.000=1.000
max1976.000-2050.000=-74.000
mean3.098-2.995=0.103
σ0.138-0.189=-0.052
min2.889-2.849=0.039
max3.261-3.310=-0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.175-1.146=0.029
σ0.320-0.343=-0.023
min0.913-0.901=0.012
max1.712-1.712=0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.572-440.565=0.007
σ573.034-573.036=-0.002
min154.046-154.042=0.003
max1300.122-1300.119=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1656.000-1655.000=1.000
σ0.000
min1656.000-1655.000=1.000
max1656.000-1655.000=1.000
mean0.561-0.552=0.009
σ0.573-0.557=0.016
min0.274-0.270=0.004
max1.421-1.388=0.033
policies=20
mean1540.695-1540.663=0.031
σ0.322-0.255=0.067
min1540.501-1540.524=-0.022
max1541.176-1541.046=0.130
mean920.000
σ0.000
min920.000
max920.000
mean1656.000-1655.000=1.000
σ0.000
min1656.000-1655.000=1.000
max1656.000-1655.000=1.000
mean2.610-2.597=0.013
σ0.013-0.017=-0.003
min2.590-2.577=0.014
max2.620-2.615=0.005
policies=200
mean15414.845-15414.618=0.227
σ0.074-0.533=-0.459
min15414.796-15413.829=0.967
max15414.953-15415.001=-0.048
mean9200.000
σ0.000
min9200.000
max9200.000
mean1656.000-1655.000=1.000
σ0.000
min1656.000-1655.000=1.000
max1656.000-1655.000=1.000
mean26.320-26.358=-0.038
σ0.109-0.103=0.006
min26.178-26.247=-0.069
max26.418-26.461=-0.044