Compare commits

Home / Compare 2c5cef9d .. fe9cbe5a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.652-53.653=-0.001
σ0.367-0.367=-0.000
min53.512-53.513=-0.001
max54.696-54.698=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.135-0.137=-0.003
σ0.004-0.004=0.001
min0.131-0.131=-0.000
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.980-42.980=0.001
σ0.007-0.007=-0.000
min42.970-42.966=0.003
max42.992-42.993=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.119-0.120=-0.001
σ0.005-0.004=0.001
min0.114-0.114=0.000
max0.128-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.971-1013.972=-0.001
σ1.172-1.172=-0.000
min1013.427-1013.405=0.021
max1018.868-1018.879=-0.012
mean1048.900-1049.450=-0.550
σ316.324-312.985=3.340
min584.000-558.000=26.000
max1653.000-1519.000=134.000
mean1.621-1.604=0.017
σ0.084-0.063=0.020
min1.481-1.480=0.001
max1.889-1.702=0.186

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.096-299.195=-0.099
σ0.204-0.268=-0.064
min298.946-298.984=-0.038
max299.656-299.898=-0.242
mean1959.000-1970.000=-11.000
σ0.000
min1959.000-1970.000=-11.000
max1959.000-1970.000=-11.000
mean0.578-0.609=-0.031
σ0.024-0.020=0.004
min0.548-0.567=-0.019
max0.619-0.640=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.678-294.680=-0.002
σ0.011-0.015=-0.003
min294.664-294.664=-0.000
max294.695-294.699=-0.003
mean1653.000-1519.000=134.000
σ0.000
min1653.000-1519.000=134.000
max1653.000-1519.000=134.000
mean0.388-0.389=-0.002
σ0.007-0.011=-0.004
min0.380-0.380=-0.000
max0.393-0.405=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1316.933-1316.942=-0.010
σ0.091-0.097=-0.006
min1316.888-1316.890=-0.002
max1317.095-1317.115=-0.020
mean1653.000-1519.000=134.000
σ0.000
min1653.000-1519.000=134.000
max1653.000-1519.000=134.000
mean1.895-1.917=-0.022
σ0.056-0.069=-0.013
min1.856-1.850=0.006
max1.993-1.989=0.004
iters=5
new-facts=6402
prior-facts=1
mean1555.299-1555.312=-0.014
σ6.893-6.900=-0.007
min1551.991-1551.994=-0.003
max1567.624-1567.651=-0.027
mean1653.000-1519.000=134.000
σ0.000
min1653.000-1519.000=134.000
max1653.000-1519.000=134.000
mean2.335-2.392=-0.056
σ0.327-0.342=-0.015
min2.139-2.074=0.065
max2.915-2.907=0.008
iters=5
new-facts=6402
prior-facts=6402
mean1884.771-1884.773=-0.001
σ0.016-0.031=-0.015
min1884.756-1884.733=0.023
max1884.793-1884.817=-0.024
mean1741.600-1768.400=-26.800
σ135.236-203.969=-68.733
min1653.000-1519.000=134.000
max1959.000-1970.000=-11.000
mean2.910-3.036=-0.125
σ0.119-0.180=-0.061
min2.831-2.864=-0.033
max3.120-3.300=-0.180

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.180-1.590=-0.411
σ0.329-0.300=0.028
min0.905-1.236=-0.331
max1.731-1.871=-0.140

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.569-440.558=0.011
σ573.035-573.024=0.011
min154.048-154.043=0.006
max1300.122-1300.094=0.027
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1519.000=134.000
σ0.000
min1653.000-1519.000=134.000
max1653.000-1519.000=134.000
mean0.541-0.544=-0.003
σ0.547-0.552=-0.005
min0.268-0.267=0.001
max1.361-1.372=-0.011
policies=20
mean1540.690-1540.675=0.015
σ0.305-0.321=-0.015
min1540.517-1540.471=0.046
max1541.148-1541.154=-0.006
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1519.000=134.000
σ0.000
min1653.000-1519.000=134.000
max1653.000-1519.000=134.000
mean2.584-2.601=-0.018
σ0.008-0.014=-0.006
min2.576-2.590=-0.014
max2.595-2.620=-0.025
policies=200
mean15414.837-15414.853=-0.015
σ0.063-0.052=0.010
min15414.800-15414.813=-0.012
max15414.931-15414.924=0.007
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1519.000=134.000
σ0.000
min1653.000-1519.000=134.000
max1653.000-1519.000=134.000
mean26.111-26.398=-0.287
σ0.120-0.184=-0.064
min25.981-26.214=-0.233
max26.255-26.643=-0.388