Compare commits

Home / Compare 1862ff3e .. 27a5ba67

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.652=0.002
σ0.368-0.367=0.001
min53.519-53.512=0.007
max54.700-54.696=0.004
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.139-0.135=0.004
σ0.003-0.004=-0.001
min0.135-0.131=0.004
max0.146-0.143=0.003
cache=y
dps=1
iters=10
policies=100
mean42.986-42.980=0.005
σ0.010-0.007=0.003
min42.972-42.970=0.002
max43.004-42.992=0.012
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.135-0.119=0.016
σ0.010-0.005=0.006
min0.115-0.114=0.001
max0.145-0.128=0.017

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.971-1013.971=0.000
σ1.167-1.172=-0.005
min1013.420-1013.427=-0.007
max1018.851-1018.868=-0.017
mean1056.800-1048.900=7.900
σ307.592-316.324=-8.732
min599.000-584.000=15.000
max1655.000-1653.000=2.000
mean1.618-1.621=-0.003
σ0.059-0.084=-0.025
min1.510-1.481=0.029
max1.758-1.889=-0.131

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.161-299.096=0.065
σ0.226-0.204=0.022
min298.953-298.946=0.007
max299.783-299.656=0.128
mean2050.000-1959.000=91.000
σ0.000
min2050.000-1959.000=91.000
max2050.000-1959.000=91.000
mean0.594-0.578=0.016
σ0.021-0.024=-0.003
min0.563-0.548=0.015
max0.621-0.619=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.677-294.678=-0.001
σ0.016-0.011=0.005
min294.651-294.664=-0.013
max294.694-294.695=-0.001
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean0.381-0.388=-0.007
σ0.001-0.007=-0.006
min0.380-0.380=0.000
max0.382-0.393=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1316.932-1316.933=-0.000
σ0.103-0.091=0.012
min1316.868-1316.888=-0.020
max1317.115-1317.095=0.020
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean1.891-1.895=-0.004
σ0.050-0.056=-0.006
min1.846-1.856=-0.011
max1.970-1.993=-0.023
iters=5
new-facts=6402
prior-facts=1
mean1555.277-1555.299=-0.022
σ6.853-6.893=-0.040
min1551.957-1551.991=-0.034
max1567.530-1567.624=-0.095
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean2.232-2.335=-0.103
σ0.164-0.327=-0.163
min2.075-2.139=-0.064
max2.500-2.915=-0.415
iters=5
new-facts=6402
prior-facts=6402
mean1884.774-1884.771=0.002
σ0.031-0.016=0.016
min1884.747-1884.756=-0.009
max1884.828-1884.793=0.036
mean1794.600-1741.600=53.000
σ171.354-135.236=36.118
min1655.000-1653.000=2.000
max2050.000-1959.000=91.000
mean3.026-2.910=0.116
σ0.173-0.119=0.053
min2.893-2.831=0.062
max3.313-3.120=0.193

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.165-1.180=-0.015
σ0.302-0.329=-0.026
min0.903-0.905=-0.002
max1.663-1.731=-0.068

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.569-440.569=-0.000
σ573.034-573.035=-0.001
min154.042-154.048=-0.007
max1300.120-1300.122=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean0.567-0.541=0.026
σ0.598-0.547=0.051
min0.266-0.268=-0.002
max1.464-1.361=0.103
policies=20
mean1540.676-1540.690=-0.015
σ0.312-0.305=0.006
min1540.496-1540.517=-0.021
max1541.143-1541.148=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean2.595-2.584=0.012
σ0.011-0.008=0.003
min2.586-2.576=0.010
max2.610-2.595=0.015
policies=200
mean15414.823-15414.837=-0.014
σ0.110-0.063=0.048
min15414.676-15414.800=-0.125
max15414.940-15414.931=0.009
mean9200.000
σ0.000
min9200.000
max9200.000
mean1655.000-1653.000=2.000
σ0.000
min1655.000-1653.000=2.000
max1655.000-1653.000=2.000
mean26.224-26.111=0.113
σ0.132-0.120=0.013
min26.100-25.981=0.119
max26.348-26.255=0.093