Compare commits

Home / Compare e9815f49 .. b7a73456

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.654=-0.000
σ0.367-0.368=-0.001
min53.516-53.517=-0.001
max54.698-54.701=-0.004
mean416.000-415.700=0.300
σ0.000-0.483=-0.483
min416.000-415.000=1.000
max416.000
mean0.138-0.139=-0.001
σ0.003-0.004=-0.001
min0.135-0.136=-0.001
max0.143-0.147=-0.004
cache=y
dps=1
iters=10
policies=100
mean42.981-42.981=-0.000
σ0.007-0.006=0.001
min42.972-42.971=0.000
max42.993-42.990=0.003
mean416.000
σ0.000
min416.000
max416.000
mean0.121-0.120=0.002
σ0.004-0.004=-0.001
min0.117-0.114=0.004
max0.127-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.973-1013.975=-0.002
σ1.175-1.176=-0.001
min1013.430-1013.434=-0.004
max1018.890-1018.895=-0.005
mean1053.850-1051.600=2.250
σ317.947-315.851=2.096
min600.000-601.000=-1.000
max1664.000-1655.000=9.000
mean1.650-1.627=0.023
σ0.104-0.059=0.045
min1.536-1.556=-0.020
max1.920-1.784=0.136

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean298.942-299.113=-0.171
σ0.244-0.198=0.046
min298.730-298.905=-0.175
max299.585-299.646=-0.061
mean2040.000-2042.000=-2.000
σ0.000
min2040.000-2042.000=-2.000
max2040.000-2042.000=-2.000
mean0.571-0.571=-0.001
σ0.021-0.022=-0.001
min0.541-0.538=0.003
max0.597-0.603=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.682-294.685=-0.003
σ0.015-0.016=-0.000
min294.661-294.664=-0.003
max294.704-294.704=0.001
mean1664.000-1655.000=9.000
σ0.000
min1664.000-1655.000=9.000
max1664.000-1655.000=9.000
mean0.387-0.385=0.002
σ0.008-0.007=0.001
min0.379-0.378=0.001
max0.398-0.392=0.006
iters=5
new-facts=1
prior-facts=6402
mean1316.931-1316.942=-0.012
σ0.082-0.096=-0.014
min1316.887-1316.885=0.002
max1317.076-1317.113=-0.037
mean1664.000-1655.000=9.000
σ0.000
min1664.000-1655.000=9.000
max1664.000-1655.000=9.000
mean1.976-1.974=0.002
σ0.093-0.112=-0.019
min1.871-1.882=-0.011
max2.071-2.129=-0.058
iters=5
new-facts=6402
prior-facts=1
mean1555.325-1555.305=0.020
σ6.796-6.852=-0.057
min1552.112-1552.020=0.093
max1567.478-1567.557=-0.079
mean1664.000-1655.000=9.000
σ0.000
min1664.000-1655.000=9.000
max1664.000-1655.000=9.000
mean2.354-2.288=0.066
σ0.190-0.242=-0.053
min2.189-2.034=0.155
max2.663-2.637=0.026
iters=5
new-facts=6402
prior-facts=6402
mean1884.772-1884.775=-0.003
σ0.017-0.035=-0.018
min1884.757-1884.746=0.011
max1884.801-1884.836=-0.035
mean1785.800-1783.000=2.800
σ158.339-162.630=-4.291
min1664.000-1655.000=9.000
max2040.000-2042.000=-2.000
mean3.021-2.968=0.054
σ0.158-0.092=0.066
min2.901-2.892=0.009
max3.238-3.093=0.145

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.051-1.216=-0.165
σ0.196-0.318=-0.122
min0.903-0.920=-0.017
max1.291-1.608=-0.317

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.680-440.681=-0.001
σ573.413-573.410=0.003
min153.963-153.968=-0.005
max1300.799-1300.796=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1664.000-1655.000=9.000
σ0.000
min1664.000-1655.000=9.000
max1664.000-1655.000=9.000
mean0.543-0.549=-0.005
σ0.564-0.557=0.007
min0.259-0.268=-0.009
max1.390-1.385=0.005
policies=20
mean1539.903-1539.910=-0.006
σ0.311-0.308=0.002
min1539.728-1539.725=0.003
max1540.369-1540.371=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1664.000-1655.000=9.000
σ0.000
min1664.000-1655.000=9.000
max1664.000-1655.000=9.000
mean2.592-2.582=0.010
σ0.021-0.009=0.012
min2.571-2.571=-0.000
max2.611-2.593=0.018
policies=200
mean15406.962-15406.950=0.012
σ0.041-0.094=-0.053
min15406.913-15406.847=0.066
max15407.011-15407.075=-0.064
mean9200.000
σ0.000
min9200.000
max9200.000
mean1664.000-1655.000=9.000
σ0.000
min1664.000-1655.000=9.000
max1664.000-1655.000=9.000
mean26.186-26.158=0.028
σ0.141-0.141=-0.000
min26.028-26.039=-0.011
max26.318-26.319=-0.001