Compare commits

Home / Compare 1cf8bd23 .. c87e012f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.655=-0.001
σ0.366-0.370=-0.004
min53.516-53.517=-0.001
max54.696-54.709=-0.013
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.138-0.140=-0.002
σ0.005-0.004=0.001
min0.129-0.135=-0.006
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.981-42.981=0.001
σ0.008-0.006=0.002
min42.969-42.974=-0.005
max42.996-42.995=0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.122-0.122=0.001
σ0.003-0.003=0.000
min0.119-0.119=0.000
max0.127-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.978-1013.967=0.011
σ1.165-1.186=-0.021
min1013.432-1013.429=0.003
max1018.853-1018.936=-0.082
mean1049.450-1056.200=-6.750
σ317.457-307.550=9.907
min583.000-599.000=-16.000
max1654.000-1655.000=-1.000
mean1.628-1.622=0.006
σ0.075-0.066=0.009
min1.535-1.550=-0.016
max1.874-1.785=0.089

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.089-299.107=-0.018
σ0.224-0.225=-0.001
min298.964-298.986=-0.022
max299.711-299.740=-0.029
mean2026.000-2039.000=-13.000
σ0.000
min2026.000-2039.000=-13.000
max2026.000-2039.000=-13.000
mean0.583-0.577=0.005
σ0.025-0.019=0.006
min0.539-0.552=-0.013
max0.605-0.599=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.680-294.677=0.003
σ0.013-0.017=-0.004
min294.664-294.653=0.011
max294.698-294.697=0.002
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean0.388-0.382=0.005
σ0.004-0.001=0.003
min0.384-0.381=0.003
max0.393-0.384=0.009
iters=5
new-facts=1
prior-facts=6402
mean1316.940-1316.931=0.009
σ0.103-0.101=0.002
min1316.879-1316.863=0.016
max1317.124-1317.111=0.013
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean1.925-1.971=-0.045
σ0.096-0.123=-0.027
min1.801-1.862=-0.062
max2.038-2.138=-0.099
iters=5
new-facts=6402
prior-facts=1
mean1555.294-1555.272=0.022
σ6.907-6.868=0.039
min1551.978-1551.974=0.004
max1567.644-1567.551=0.093
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean2.290-2.305=-0.014
σ0.322-0.314=0.008
min2.080-2.104=-0.024
max2.861-2.838=0.023
iters=5
new-facts=6402
prior-facts=6402
mean1884.768-1884.766=0.001
σ0.018-0.033=-0.015
min1884.746-1884.736=0.010
max1884.795-1884.822=-0.026
mean1784.400-1782.200=2.200
σ159.971-161.869=-1.898
min1654.000-1655.000=-1.000
max2026.000-2039.000=-13.000
mean2.959-2.939=0.020
σ0.119-0.070=0.048
min2.847-2.867=-0.019
max3.155-3.030=0.125

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.130-1.140=-0.009
σ0.293-0.260=0.033
min0.898-0.908=-0.010
max1.590-1.555=0.035

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.680-440.563=0.117
σ573.418-573.041=0.377
min153.967-154.041=-0.074
max1300.807-1300.125=0.682
mean96.250
σ8.500
min92.000
max109.000
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean0.545-0.546=-0.001
σ0.549-0.541=0.007
min0.269-0.274=-0.005
max1.368-1.358=0.010
policies=20
mean1539.920-1540.677=-0.757
σ0.313-0.316=-0.003
min1539.752-1540.511=-0.759
max1540.388-1541.150=-0.762
mean920.000
σ0.000
min920.000
max920.000
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean2.600-2.619=-0.019
σ0.007-0.017=-0.009
min2.593-2.598=-0.004
max2.608-2.635=-0.027
policies=200
mean15407.051-15414.647=-7.596
σ0.073-0.173=-0.100
min15407.006-15414.500=-7.494
max15407.160-15414.845=-7.686
mean9200.000
σ0.000
min9200.000
max9200.000
mean1654.000-1655.000=-1.000
σ0.000
min1654.000-1655.000=-1.000
max1654.000-1655.000=-1.000
mean26.329-26.300=0.029
σ0.134-0.207=-0.074
min26.190-26.046=0.144
max26.443-26.523=-0.080