Compare commits

Home / Compare 8af7cf69 .. dbff526c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.653=0.001
σ0.367-0.367=0.000
min53.517-53.511=0.006
max54.700-54.698=0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.140-0.137=0.002
σ0.005-0.005=0.000
min0.136-0.130=0.005
max0.152-0.144=0.008
cache=y
dps=1
iters=10
policies=100
mean42.981-42.979=0.002
σ0.005-0.006=-0.001
min42.975-42.971=0.004
max42.991-42.990=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.119-0.120=-0.001
σ0.005-0.004=0.001
min0.113-0.115=-0.002
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.976-1013.973=0.003
σ1.168-1.169=-0.001
min1013.410-1013.431=-0.022
max1018.866-1018.862=0.004
mean1055.500-1046.750=8.750
σ307.264-315.945=-8.681
min600.000-598.000=2.000
max1655.000-1651.000=4.000
mean1.583-1.661=-0.079
σ0.061-0.124=-0.063
min1.506-1.554=-0.049
max1.696-2.074=-0.378

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.249-299.066=0.183
σ0.228-0.202=0.027
min299.035-298.909=0.126
max299.813-299.615=0.198
mean1957.000-2032.000=-75.000
σ0.000
min1957.000-2032.000=-75.000
max1957.000-2032.000=-75.000
mean0.564-0.570=-0.007
σ0.019-0.018=0.001
min0.537-0.545=-0.008
max0.595-0.591=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.681-294.681=-0.000
σ0.014-0.010=0.004
min294.664-294.666=-0.002
max294.703-294.694=0.009
mean1655.000-1651.000=4.000
σ0.000
min1655.000-1651.000=4.000
max1655.000-1651.000=4.000
mean0.378-0.383=-0.005
σ0.003-0.005=-0.003
min0.376-0.379=-0.004
max0.382-0.393=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1316.948-1316.936=0.012
σ0.100-0.102=-0.002
min1316.882-1316.860=0.023
max1317.125-1317.116=0.009
mean1655.000-1651.000=4.000
σ0.000
min1655.000-1651.000=4.000
max1655.000-1651.000=4.000
mean1.965-1.872=0.093
σ0.072-0.102=-0.030
min1.879-1.746=0.132
max2.078-1.966=0.112
iters=5
new-facts=6402
prior-facts=1
mean1555.322-1555.288=0.033
σ6.872-6.878=-0.006
min1551.988-1551.959=0.028
max1567.607-1567.586=0.021
mean1655.000-1651.000=4.000
σ0.000
min1655.000-1651.000=4.000
max1655.000-1651.000=4.000
mean2.407-2.287=0.120
σ0.310-0.248=0.062
min2.083-2.128=-0.045
max2.850-2.724=0.126
iters=5
new-facts=6402
prior-facts=6402
mean1884.784-1884.780=0.004
σ0.037-0.041=-0.004
min1884.760-1884.749=0.011
max1884.849-1884.852=-0.003
mean1791.800-1782.000=9.800
σ109.960-166.337=-56.377
min1655.000-1651.000=4.000
max1957.000-2032.000=-75.000
mean3.007-2.943=0.064
σ0.120-0.115=0.005
min2.893-2.872=0.020
max3.191-3.147=0.044

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.186-1.216=-0.030
σ0.263-0.326=-0.063
min0.912-0.919=-0.007
max1.600-1.763=-0.163

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.683-440.680=0.004
σ573.412-573.411=0.001
min153.972-153.968=0.004
max1300.801-1300.796=0.005
mean96.250
σ8.500
min92.000
max109.000
mean1655.000-1651.000=4.000
σ0.000
min1655.000-1651.000=4.000
max1655.000-1651.000=4.000
mean0.553-0.549=0.004
σ0.569-0.569=-0.000
min0.264-0.262=0.002
max1.406-1.402=0.004
policies=20
mean1539.917-1539.887=0.030
σ0.314-0.265=0.049
min1539.741-1539.726=0.016
max1540.388-1540.283=0.104
mean920.000
σ0.000
min920.000
max920.000
mean1655.000-1651.000=4.000
σ0.000
min1655.000-1651.000=4.000
max1655.000-1651.000=4.000
mean2.604-2.597=0.007
σ0.010-0.014=-0.004
min2.593-2.582=0.011
max2.612-2.615=-0.003
policies=200
mean15406.946-15406.948=-0.001
σ0.152-0.137=0.015
min15406.840-15406.775=0.065
max15407.171-15407.086=0.085
mean9200.000
σ0.000
min9200.000
max9200.000
mean1655.000-1651.000=4.000
σ0.000
min1655.000-1651.000=4.000
max1655.000-1651.000=4.000
mean26.318-26.353=-0.034
σ0.125-0.238=-0.113
min26.188-26.154=0.034
max26.431-26.693=-0.262