Compare commits

Home / Compare 2ffe6ba1 .. 078f666e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.838-53.836=0.002
σ0.370-0.366=0.004
min53.692-53.697=-0.005
max54.889-54.877=0.012
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.139-0.138=0.001
σ0.004-0.004=0.001
min0.136-0.135=0.001
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.001
σ0.007-0.005=0.002
min43.195-43.200=-0.005
max43.218-43.214=0.004
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.119-0.121=-0.002
σ0.004-0.004=-0.000
min0.114-0.116=-0.002
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.203-1016.207=-0.003
σ1.185-1.160=0.025
min1015.634-1015.630=0.003
max1021.169-1021.056=0.113
mean1049.150-1048.400=0.750
σ311.163-297.379=13.784
min557.000-589.000=-32.000
max1513.000-1467.000=46.000
mean1.516-1.515=0.000
σ0.050-0.074=-0.023
min1.451-1.443=0.009
max1.633-1.696=-0.063

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.067-301.400=-0.334
σ0.317-0.232=0.084
min300.843-301.255=-0.412
max301.945-302.047=-0.102
mean2042.000-2018.000=24.000
σ0.000
min2042.000-2018.000=24.000
max2042.000-2018.000=24.000
mean0.562-0.550=0.013
σ0.030-0.028=0.002
min0.504-0.501=0.004
max0.592-0.579=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.484-301.467=0.017
σ0.044-0.076=-0.032
min301.418-301.341=0.077
max301.538-301.537=0.001
mean1513.000-1467.000=46.000
σ0.000
min1513.000-1467.000=46.000
max1513.000-1467.000=46.000
mean0.394-0.396=-0.002
σ0.007-0.009=-0.003
min0.387-0.390=-0.002
max0.401-0.413=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1324.056-1324.066=-0.009
σ0.108-0.114=-0.005
min1323.924-1323.927=-0.003
max1324.200-1324.207=-0.007
mean1513.000-1467.000=46.000
σ0.000
min1513.000-1467.000=46.000
max1513.000-1467.000=46.000
mean1.938-1.917=0.021
σ0.105-0.091=0.013
min1.834-1.819=0.015
max2.058-2.038=0.020
iters=5
new-facts=6402
prior-facts=1
mean1562.063-1562.079=-0.016
σ6.909-6.928=-0.019
min1558.737-1558.773=-0.036
max1574.417-1574.467=-0.050
mean1513.000-1467.000=46.000
σ0.000
min1513.000-1467.000=46.000
max1513.000-1467.000=46.000
mean2.248-2.275=-0.027
σ0.220-0.246=-0.026
min2.085-2.068=0.017
max2.633-2.668=-0.035
iters=5
new-facts=6402
prior-facts=6402
mean1891.969-1891.953=0.016
σ0.065-0.072=-0.008
min1891.856-1891.855=0.001
max1892.014-1892.009=0.005
mean1733.800-1718.400=15.400
σ213.328-216.768=-3.440
min1513.000-1467.000=46.000
max2042.000-2018.000=24.000
mean3.008-3.023=-0.015
σ0.195-0.201=-0.005
min2.866-2.867=-0.001
max3.333-3.325=0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.594-1.743=-0.150
σ0.296-0.067=0.229
min1.229-1.631=-0.402
max1.822-1.797=0.025

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.724-443.474=0.250
σ574.722-574.226=0.496
min156.362-156.358=0.004
max1305.807-1304.813=0.994
mean96.250
σ8.500
min92.000
max109.000
mean1513.000-1467.000=46.000
σ0.000
min1513.000-1467.000=46.000
max1513.000-1467.000=46.000
mean0.537-0.542=-0.005
σ0.548-0.558=-0.010
min0.262-0.260=0.002
max1.359-1.380=-0.021
policies=20
mean1563.905-1563.877=0.028
σ0.334-0.336=-0.002
min1563.693-1563.677=0.017
max1564.403-1564.379=0.024
mean920.000
σ0.000
min920.000
max920.000
mean1513.000-1467.000=46.000
σ0.000
min1513.000-1467.000=46.000
max1513.000-1467.000=46.000
mean2.614-2.622=-0.009
σ0.006-0.018=-0.012
min2.607-2.607=0.001
max2.619-2.645=-0.027
policies=200
mean15646.994-15646.936=0.058
σ0.083-0.172=-0.089
min15646.939-15646.790=0.149
max15647.116-15647.156=-0.040
mean9200.000
σ0.000
min9200.000
max9200.000
mean1513.000-1467.000=46.000
σ0.000
min1513.000-1467.000=46.000
max1513.000-1467.000=46.000
mean26.454-26.469=-0.015
σ0.126-0.161=-0.035
min26.321-26.329=-0.008
max26.566-26.634=-0.068