Compare commits

Home / Compare 125dc8be .. 41d3ca14

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.821=0.001
σ0.367-0.368=-0.001
min53.681-53.676=0.005
max54.866-54.867=-0.001
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.139-0.139=-0.000
σ0.004-0.003=0.000
min0.135-0.136=-0.000
max0.144-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.001
σ0.006-0.007=-0.000
min43.201-43.199=0.001
max43.222-43.218=0.003
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.121-0.122=-0.001
σ0.005-0.004=0.001
min0.114-0.118=-0.004
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.175-1016.177=-0.002
σ1.158-1.168=-0.010
min1015.624-1015.600=0.025
max1021.017-1021.067=-0.050
mean1043.850-1046.150=-2.300
σ311.488-312.330=-0.842
min589.000-554.000=35.000
max1636.000-1513.000=123.000
mean1.571-1.549=0.022
σ0.075-0.052=0.023
min1.497-1.490=0.007
max1.788-1.659=0.129

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.568-301.475=0.093
σ0.190-0.217=-0.026
min301.373-301.304=0.069
max302.016-302.062=-0.046
mean1956.000-2025.000=-69.000
σ0.000
min1956.000-2025.000=-69.000
max1956.000-2025.000=-69.000
mean0.553-0.551=0.002
σ0.038-0.034=0.004
min0.511-0.504=0.007
max0.606-0.599=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.689-300.690=-0.001
σ0.032-0.037=-0.004
min300.634-300.630=0.004
max300.714-300.726=-0.012
mean1636.000-1513.000=123.000
σ0.000
min1636.000-1513.000=123.000
max1636.000-1513.000=123.000
mean0.399-0.401=-0.002
σ0.007-0.009=-0.002
min0.391-0.391=0.000
max0.407-0.411=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1322.871-1322.870=0.000
σ0.062-0.088=-0.026
min1322.810-1322.816=-0.006
max1322.962-1323.022=-0.060
mean1636.000-1513.000=123.000
σ0.000
min1636.000-1513.000=123.000
max1636.000-1513.000=123.000
mean2.056-1.868=0.188
σ0.250-0.049=0.202
min1.785-1.823=-0.038
max2.423-1.940=0.483
iters=5
new-facts=6402
prior-facts=1
mean1561.395-1561.322=0.073
σ6.841-6.880=-0.039
min1558.194-1558.074=0.120
max1573.630-1573.625=0.005
mean1636.000-1513.000=123.000
σ0.000
min1636.000-1513.000=123.000
max1636.000-1513.000=123.000
mean2.424-2.345=0.079
σ0.235-0.343=-0.109
min2.175-2.046=0.129
max2.700-2.727=-0.027
iters=5
new-facts=6402
prior-facts=6402
mean1890.796-1890.798=-0.002
σ0.012-0.027=-0.015
min1890.787-1890.777=0.010
max1890.815-1890.844=-0.029
mean1786.600-1726.000=60.600
σ118.069-209.645=-91.576
min1636.000-1513.000=123.000
max1956.000-2025.000=-69.000
mean2.996-2.900=0.096
σ0.087-0.053=0.034
min2.897-2.850=0.047
max3.088-2.990=0.098

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.161-1.453=-0.292
σ0.329-0.408=-0.079
min0.919-0.929=-0.010
max1.703-1.832=-0.129

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.047-443.040=0.008
σ573.417-573.399=0.018
min156.337-156.334=0.003
max1303.173-1303.139=0.034
mean96.250
σ8.500
min92.000
max109.000
mean1636.000-1513.000=123.000
σ0.000
min1636.000-1513.000=123.000
max1636.000-1513.000=123.000
mean0.535-0.531=0.004
σ0.537-0.538=-0.002
min0.258-0.259=-0.001
max1.340-1.338=0.001
policies=20
mean1563.640-1563.618=0.021
σ0.338-0.334=0.004
min1563.451-1563.408=0.043
max1564.145-1564.117=0.029
mean920.000
σ0.000
min920.000
max920.000
mean1636.000-1513.000=123.000
σ0.000
min1636.000-1513.000=123.000
max1636.000-1513.000=123.000
mean2.637-2.617=0.019
σ0.023-0.019=0.005
min2.604-2.597=0.007
max2.658-2.642=0.016
policies=200
mean15643.980-15644.167=-0.187
σ0.290-0.081=0.209
min15643.606-15644.104=-0.499
max15644.313-15644.284=0.029
mean9200.000
σ0.000
min9200.000
max9200.000
mean1636.000-1513.000=123.000
σ0.000
min1636.000-1513.000=123.000
max1636.000-1513.000=123.000
mean26.686-26.679=0.006
σ0.078-0.182=-0.104
min26.608-26.486=0.123
max26.767-26.903=-0.135