Compare commits

Home / Compare 3bd15c0c .. 8b1fda71

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.652=0.003
σ0.368-0.368=-0.000
min53.510-53.510=0.000
max54.703-54.700=0.002
mean418.000-421.000=-3.000
σ0.000
min418.000-421.000=-3.000
max418.000-421.000=-3.000
mean0.135-0.136=-0.001
σ0.005-0.005=-0.000
min0.129-0.129=0.001
max0.141-0.141=-0.000
cache=y
dps=1
iters=10
policies=100
mean42.981-42.980=0.001
σ0.007-0.006=0.001
min42.971-42.973=-0.002
max42.992-42.989=0.002
mean418.000-421.000=-3.000
σ0.000
min418.000-421.000=-3.000
max418.000-421.000=-3.000
mean0.121-0.120=0.001
σ0.003-0.003=0.000
min0.115-0.118=-0.003
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.974-1013.973=0.001
σ1.158-1.170=-0.012
min1013.429-1013.428=0.001
max1018.812-1018.870=-0.058
mean1053.150-1056.800=-3.650
σ318.617-315.212=3.405
min587.000-607.000=-20.000
max1663.000-1659.000=4.000
mean1.620-1.629=-0.009
σ0.077-0.103=-0.026
min1.547-1.481=0.065
max1.864-1.896=-0.032

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.170-299.027=0.143
σ0.211-0.252=-0.041
min299.038-298.855=0.183
max299.766-299.726=0.040
mean2044.000-1973.000=71.000
σ0.000
min2044.000-1973.000=71.000
max2044.000-1973.000=71.000
mean0.599-0.580=0.019
σ0.025-0.016=0.009
min0.552-0.555=-0.003
max0.618-0.598=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.676-294.676=-0.000
σ0.011-0.010=0.002
min294.660-294.662=-0.002
max294.692-294.689=0.004
mean1663.000-1659.000=4.000
σ0.000
min1663.000-1659.000=4.000
max1663.000-1659.000=4.000
mean0.382-0.383=-0.001
σ0.006-0.007=-0.001
min0.375-0.379=-0.004
max0.388-0.396=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1316.940-1316.941=-0.001
σ0.106-0.093=0.013
min1316.874-1316.883=-0.009
max1317.124-1317.105=0.020
mean1663.000-1659.000=4.000
σ0.000
min1663.000-1659.000=4.000
max1663.000-1659.000=4.000
mean1.968-1.882=0.086
σ0.111-0.054=0.057
min1.864-1.842=0.022
max2.150-1.977=0.173
iters=5
new-facts=6402
prior-facts=1
mean1555.272-1555.282=-0.010
σ6.842-6.880=-0.038
min1551.966-1551.959=0.007
max1567.505-1567.584=-0.079
mean1663.000-1659.000=4.000
σ0.000
min1663.000-1659.000=4.000
max1663.000-1659.000=4.000
mean2.238-2.245=-0.007
σ0.226-0.278=-0.052
min2.102-2.061=0.041
max2.641-2.738=-0.097
iters=5
new-facts=6402
prior-facts=6402
mean1884.776-1884.777=-0.001
σ0.038-0.034=0.004
min1884.737-1884.756=-0.019
max1884.840-1884.837=0.003
mean1789.800-1749.800=40.000
σ163.553-138.720=24.833
min1663.000-1659.000=4.000
max2044.000-1973.000=71.000
mean2.911-2.974=-0.063
σ0.143-0.119=0.024
min2.722-2.866=-0.144
max3.126-3.127=-0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.088-1.197=-0.109
σ0.167-0.270=-0.103
min0.908-0.909=-0.001
max1.318-1.594=-0.276

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.581-440.580=0.001
σ573.054-573.056=-0.001
min154.044-154.045=-0.001
max1300.162-1300.164=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1663.000-1659.000=4.000
σ0.000
min1663.000-1659.000=4.000
max1663.000-1659.000=4.000
mean0.546-0.556=-0.011
σ0.552-0.575=-0.024
min0.268-0.267=0.000
max1.373-1.419=-0.046
policies=20
mean1540.683-1540.676=0.007
σ0.302-0.288=0.014
min1540.517-1540.515=0.002
max1541.136-1541.108=0.029
mean920.000
σ0.000
min920.000
max920.000
mean1663.000-1659.000=4.000
σ0.000
min1663.000-1659.000=4.000
max1663.000-1659.000=4.000
mean2.591-2.580=0.011
σ0.008-0.016=-0.008
min2.582-2.561=0.020
max2.601-2.601=-0.000
policies=200
mean15414.739-15414.754=-0.016
σ0.004-0.176=-0.172
min15414.736-15414.605=0.130
max15414.744-15414.987=-0.243
mean9200.000
σ0.000
min9200.000
max9200.000
mean1663.000-1659.000=4.000
σ0.000
min1663.000-1659.000=4.000
max1663.000-1659.000=4.000
mean26.142-26.204=-0.062
σ0.099-0.124=-0.025
min26.042-26.065=-0.023
max26.242-26.319=-0.077