Compare commits

Home / Compare 1a24f5c1 .. 0ae6ff0f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.655=0.169
σ0.372-0.369=0.002
min53.679-53.523=0.156
max54.880-54.705=0.175
mean418.000-420.000=-2.000
σ0.000
min418.000-420.000=-2.000
max418.000-420.000=-2.000
mean0.142-0.139=0.003
σ0.010-0.009=0.000
min0.136-0.131=0.004
max0.167-0.161=0.005
cache=y
dps=1
iters=10
policies=100
mean43.207-42.981=0.227
σ0.007-0.006=0.001
min43.196-42.972=0.224
max43.219-42.994=0.225
mean418.000-420.000=-2.000
σ0.000
min418.000-420.000=-2.000
max418.000-420.000=-2.000
mean0.118-0.120=-0.002
σ0.005-0.004=0.002
min0.114-0.115=-0.002
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.173-1013.977=2.196
σ1.189-1.159=0.030
min1015.629-1013.403=2.226
max1021.145-1018.823=2.322
mean1051.800-1051.600=0.200
σ312.566-317.679=-5.113
min559.000-604.000=-45.000
max1519.000-1654.000=-135.000
mean1.539-1.609=-0.070
σ0.072-0.072=0.000
min1.459-1.541=-0.083
max1.741-1.862=-0.121

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.374-299.060=2.315
σ0.208-0.243=-0.035
min301.255-298.845=2.410
max301.957-299.709=2.248
mean1965.000-1909.000=56.000
σ0.000
min1965.000-1909.000=56.000
max1965.000-1909.000=56.000
mean0.561-0.610=-0.049
σ0.033-0.025=0.008
min0.510-0.584=-0.074
max0.600-0.657=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.696-294.683=6.014
σ0.032-0.013=0.020
min300.645-294.667=5.977
max300.728-294.701=6.027
mean1519.000-1654.000=-135.000
σ0.000
min1519.000-1654.000=-135.000
max1519.000-1654.000=-135.000
mean0.400-0.384=0.016
σ0.005-0.010=-0.004
min0.392-0.375=0.016
max0.404-0.395=0.009
iters=5
new-facts=1
prior-facts=6402
mean1322.873-1316.943=5.930
σ0.099-0.111=-0.013
min1322.808-1316.833=5.975
max1323.041-1317.127=5.914
mean1519.000-1654.000=-135.000
σ0.000
min1519.000-1654.000=-135.000
max1519.000-1654.000=-135.000
mean1.910-2.024=-0.114
σ0.044-0.093=-0.049
min1.844-1.939=-0.095
max1.965-2.182=-0.216
iters=5
new-facts=6402
prior-facts=1
mean1561.296-1555.323=5.973
σ6.887-6.836=0.051
min1557.973-1552.015=5.958
max1573.611-1567.547=6.063
mean1519.000-1654.000=-135.000
σ0.000
min1519.000-1654.000=-135.000
max1519.000-1654.000=-135.000
mean2.221-2.387=-0.166
σ0.237-0.245=-0.008
min2.072-2.147=-0.075
max2.637-2.656=-0.019
iters=5
new-facts=6402
prior-facts=6402
mean1890.805-1884.774=6.031
σ0.028-0.038=-0.010
min1890.782-1884.747=6.036
max1890.853-1884.839=6.013
mean1775.200-1773.600=1.600
σ158.400-128.718=29.683
min1534.000-1654.000=-120.000
max1965.000-1909.000=56.000
mean3.009-3.084=-0.075
σ0.163-0.404=-0.241
min2.856-2.809=0.047
max3.258-3.753=-0.495

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.530-1.177=0.353
σ0.280-0.379=-0.099
min1.219-0.917=0.302
max1.768-1.815=-0.047

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.319-440.678=2.641
σ573.962-573.418=0.544
min156.333-153.964=2.369
max1304.262-1300.805=3.457
mean96.250
σ8.500
min92.000
max109.000
mean1519.000-1654.000=-135.000
σ0.000
min1519.000-1654.000=-135.000
max1519.000-1654.000=-135.000
mean0.524-0.531=-0.007
σ0.527-0.509=0.018
min0.257-0.274=-0.017
max1.315-1.295=0.020
policies=20
mean1563.607-1539.922=23.685
σ0.329-0.315=0.013
min1563.396-1539.754=23.642
max1564.098-1540.395=23.703
mean920.000
σ0.000
min920.000
max920.000
mean1519.000-1654.000=-135.000
σ0.000
min1519.000-1654.000=-135.000
max1519.000-1654.000=-135.000
mean2.607-2.596=0.010
σ0.018-0.012=0.006
min2.587-2.580=0.008
max2.629-2.607=0.022
policies=200
mean15644.025-15407.048=236.977
σ0.086-0.052=0.033
min15643.942-15406.990=236.952
max15644.112-15407.116=236.996
mean9200.000
σ0.000
min9200.000
max9200.000
mean1519.000-1654.000=-135.000
σ0.000
min1519.000-1654.000=-135.000
max1519.000-1654.000=-135.000
mean26.411-26.435=-0.024
σ0.157-0.078=0.078
min26.209-26.342=-0.133
max26.561-26.522=0.039