Compare commits

Home / Compare c012b7e0 .. 7d63cdf4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.655=-0.001
σ0.367-0.368=-0.001
min53.518-53.512=0.006
max54.696-54.701=-0.005
mean412.000-419.000=-7.000
σ0.000
min412.000-419.000=-7.000
max412.000-419.000=-7.000
mean0.136-0.139=-0.003
σ0.005-0.003=0.001
min0.130-0.136=-0.006
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.981-42.983=-0.002
σ0.007-0.005=0.002
min42.974-42.977=-0.003
max42.995-42.990=0.005
mean412.000-419.000=-7.000
σ0.000
min412.000-419.000=-7.000
max412.000-419.000=-7.000
mean0.121-0.128=-0.007
σ0.003-0.009=-0.006
min0.118-0.118=-0.000
max0.128-0.140=-0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.969-1013.970=-0.002
σ1.192-1.178=0.014
min1013.426-1013.418=0.008
max1018.966-1018.901=0.064
mean1051.150-1049.750=1.400
σ316.878-294.462=22.416
min591.000-605.000=-14.000
max1661.000-1438.000=223.000
mean1.614-1.609=0.005
σ0.073-0.057=0.016
min1.523-1.496=0.027
max1.825-1.710=0.115

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.190-299.224=-0.034
σ0.163-0.238=-0.075
min299.029-299.092=-0.063
max299.609-299.894=-0.285
mean1962.000-1970.000=-8.000
σ0.000
min1962.000-1970.000=-8.000
max1962.000-1970.000=-8.000
mean0.571-0.575=-0.004
σ0.027-0.022=0.005
min0.545-0.541=0.004
max0.623-0.600=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.673-294.677=-0.004
σ0.014-0.016=-0.002
min294.650-294.655=-0.005
max294.689-294.700=-0.011
mean1661.000-1438.000=223.000
σ0.000
min1661.000-1438.000=223.000
max1661.000-1438.000=223.000
mean0.381-0.390=-0.009
σ0.001-0.011=-0.009
min0.379-0.380=-0.002
max0.382-0.407=-0.025
iters=5
new-facts=1
prior-facts=6402
mean1316.933-1316.937=-0.004
σ0.107-0.101=0.005
min1316.875-1316.887=-0.012
max1317.123-1317.118=0.005
mean1661.000-1438.000=223.000
σ0.000
min1661.000-1438.000=223.000
max1661.000-1438.000=223.000
mean1.945-1.902=0.043
σ0.055-0.079=-0.024
min1.865-1.837=0.029
max2.009-1.994=0.016
iters=5
new-facts=6402
prior-facts=1
mean1555.302-1555.281=0.021
σ6.887-6.870=0.017
min1551.994-1551.949=0.045
max1567.615-1567.565=0.051
mean1661.000-1438.000=223.000
σ0.000
min1661.000-1438.000=223.000
max1661.000-1438.000=223.000
mean2.349-2.226=0.124
σ0.318-0.215=0.103
min2.079-2.113=-0.034
max2.895-2.610=0.285
iters=5
new-facts=6402
prior-facts=6402
mean1884.775-1884.778=-0.003
σ0.029-0.028=0.001
min1884.753-1884.752=0.001
max1884.826-1884.823=0.003
mean1785.800-1724.400=61.400
σ111.264-166.093=-54.829
min1661.000-1536.000=125.000
max1962.000-1970.000=-8.000
mean3.007-2.952=0.055
σ0.113-0.073=0.040
min2.851-2.874=-0.023
max3.122-3.053=0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.686=-0.491
σ0.285-0.169=0.116
min0.986-1.410=-0.424
max1.680-1.856=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.565-440.554=0.012
σ573.035-573.019=0.016
min154.044-154.037=0.007
max1300.118-1300.082=0.036
mean96.250
σ8.500
min92.000
max109.000
mean1661.000-1438.000=223.000
σ0.000
min1661.000-1438.000=223.000
max1661.000-1438.000=223.000
mean0.546-0.535=0.011
σ0.554-0.532=0.022
min0.268-0.264=0.004
max1.377-1.333=0.044
policies=20
mean1540.669-1540.673=-0.004
σ0.310-0.327=-0.016
min1540.508-1540.453=0.054
max1541.135-1541.159=-0.025
mean920.000
σ0.000
min920.000
max920.000
mean1661.000-1438.000=223.000
σ0.000
min1661.000-1438.000=223.000
max1661.000-1438.000=223.000
mean2.603-2.594=0.009
σ0.015-0.014=0.000
min2.588-2.577=0.011
max2.622-2.612=0.010
policies=200
mean15414.606-15414.865=-0.259
σ0.096-0.070=0.026
min15414.527-15414.798=-0.271
max15414.746-15414.955=-0.209
mean9200.000
σ0.000
min9200.000
max9200.000
mean1661.000-1438.000=223.000
σ0.000
min1661.000-1438.000=223.000
max1661.000-1438.000=223.000
mean26.212-26.243=-0.031
σ0.096-0.122=-0.026
min26.095-26.112=-0.017
max26.329-26.405=-0.076