Compare commits

Home / Compare 785762d9 .. 72c57c3b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.654=0.000
σ0.366-0.368=-0.001
min53.516-53.519=-0.003
max54.696-54.700=-0.004
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.138-0.139=-0.001
σ0.005-0.003=0.002
min0.129-0.135=-0.006
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.981-42.986=-0.005
σ0.008-0.010=-0.002
min42.969-42.972=-0.003
max42.996-43.004=-0.007
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.122-0.135=-0.013
σ0.003-0.010=-0.007
min0.119-0.115=0.004
max0.127-0.145=-0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.978-1013.971=0.007
σ1.165-1.167=-0.002
min1013.432-1013.420=0.012
max1018.853-1018.851=0.002
mean1049.450-1056.800=-7.350
σ317.457-307.592=9.865
min583.000-599.000=-16.000
max1654.000-1655.000=-1.000
mean1.628-1.618=0.010
σ0.075-0.059=0.016
min1.535-1.510=0.025
max1.874-1.758=0.116

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.089-299.161=-0.072
σ0.224-0.226=-0.003
min298.964-298.953=0.010
max299.711-299.783=-0.072
mean2026.000-2050.000=-24.000
σ0.000
min2026.000-2050.000=-24.000
max2026.000-2050.000=-24.000
mean0.583-0.594=-0.011
σ0.025-0.021=0.004
min0.539-0.563=-0.024
max0.605-0.621=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.680-294.677=0.003
σ0.013-0.016=-0.003
min294.664-294.651=0.014
max294.698-294.694=0.004
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean0.388-0.381=0.007
σ0.004-0.001=0.004
min0.384-0.380=0.004
max0.393-0.382=0.011
iters=5
new-facts=1
prior-facts=6402
mean1316.940-1316.932=0.008
σ0.103-0.103=0.001
min1316.879-1316.868=0.011
max1317.124-1317.115=0.009
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean1.925-1.891=0.035
σ0.096-0.050=0.046
min1.801-1.846=-0.045
max2.038-1.970=0.068
iters=5
new-facts=6402
prior-facts=1
mean1555.294-1555.277=0.017
σ6.907-6.853=0.054
min1551.978-1551.957=0.021
max1567.644-1567.530=0.114
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean2.290-2.232=0.058
σ0.322-0.164=0.157
min2.080-2.075=0.005
max2.861-2.500=0.361
iters=5
new-facts=6402
prior-facts=6402
mean1884.768-1884.774=-0.006
σ0.018-0.031=-0.014
min1884.746-1884.747=-0.001
max1884.795-1884.828=-0.033
mean1784.400-1794.600=-10.200
σ159.971-171.354=-11.383
min1654.000-1655.000=-1.000
max2026.000-2050.000=-24.000
mean2.959-3.026=-0.067
σ0.119-0.173=-0.054
min2.847-2.893=-0.045
max3.155-3.313=-0.158

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.130-1.165=-0.034
σ0.293-0.302=-0.010
min0.898-0.903=-0.005
max1.590-1.663=-0.073

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.680-440.569=0.112
σ573.418-573.034=0.384
min153.967-154.042=-0.074
max1300.807-1300.120=0.687
mean96.250
σ8.500
min92.000
max109.000
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean0.545-0.567=-0.022
σ0.549-0.598=-0.049
min0.269-0.266=0.003
max1.368-1.464=-0.096
policies=20
mean1539.920-1540.676=-0.756
σ0.313-0.312=0.001
min1539.752-1540.496=-0.744
max1540.388-1541.143=-0.755
mean920.000
σ0.000
min920.000
max920.000
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean2.600-2.595=0.005
σ0.007-0.011=-0.003
min2.593-2.586=0.007
max2.608-2.610=-0.002
policies=200
mean15407.051-15414.823=-7.772
σ0.073-0.110=-0.038
min15407.006-15414.676=-7.669
max15407.160-15414.940=-7.780
mean9200.000
σ0.000
min9200.000
max9200.000
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean26.329-26.224=0.105
σ0.134-0.132=0.001
min26.190-26.100=0.090
max26.443-26.348=0.096