Compare commits

Home / Compare 6ec558b1 .. d1b8379d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.822=0.001
σ0.365-0.366=-0.001
min53.681-53.681=0.000
max54.861-54.863=-0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.140-0.140=-0.000
σ0.004-0.003=0.001
min0.135-0.136=-0.001
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.209-43.208=0.001
σ0.006-0.006=-0.000
min43.201-43.200=0.001
max43.218-43.217=0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.121-0.121=-0.000
σ0.004-0.004=-0.000
min0.115-0.115=-0.001
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.175-1016.179=-0.005
σ1.166-1.159=0.007
min1015.638-1015.602=0.036
max1021.050-1021.027=0.023
mean1041.650-1049.750=-8.100
σ310.400-312.253=-1.853
min596.000-557.000=39.000
max1632.000-1516.000=116.000
mean1.575-1.569=0.006
σ0.094-0.068=0.025
min1.499-1.500=-0.001
max1.845-1.745=0.099

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.284-301.515=-0.231
σ0.233-0.162=0.072
min301.116-301.340=-0.225
max301.894-301.904=-0.011
mean1948.000-2013.000=-65.000
σ0.000
min1948.000-2013.000=-65.000
max1948.000-2013.000=-65.000
mean0.574-0.569=0.006
σ0.033-0.036=-0.003
min0.513-0.503=0.010
max0.610-0.616=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.695-300.688=0.008
σ0.024-0.033=-0.008
min300.664-300.633=0.031
max300.726-300.717=0.009
mean1632.000-1516.000=116.000
σ0.000
min1632.000-1516.000=116.000
max1632.000-1516.000=116.000
mean0.398-0.393=0.005
σ0.008-0.006=0.002
min0.391-0.387=0.004
max0.410-0.400=0.010
iters=5
new-facts=1
prior-facts=6402
mean1322.869-1322.881=-0.012
σ0.096-0.068=0.028
min1322.813-1322.812=0.001
max1323.040-1322.960=0.080
mean1632.000-1516.000=116.000
σ0.000
min1632.000-1516.000=116.000
max1632.000-1516.000=116.000
mean1.923-2.081=-0.158
σ0.065-0.245=-0.180
min1.826-1.819=0.007
max1.994-2.332=-0.339
iters=5
new-facts=6402
prior-facts=1
mean1561.318-1561.364=-0.047
σ6.905-6.835=0.070
min1557.998-1558.203=-0.205
max1573.665-1573.590=0.074
mean1632.000-1516.000=116.000
σ0.000
min1632.000-1516.000=116.000
max1632.000-1516.000=116.000
mean2.331-2.351=-0.020
σ0.296-0.251=0.045
min2.087-2.114=-0.027
max2.835-2.656=0.179
iters=5
new-facts=6402
prior-facts=6402
mean1890.804-1890.789=0.015
σ0.037-0.017=0.020
min1890.776-1890.771=0.005
max1890.868-1890.815=0.053
mean1780.400-1731.400=49.000
σ116.843-208.380=-91.537
min1632.000-1516.000=116.000
max1948.000-2013.000=-65.000
mean3.025-2.927=0.098
σ0.182-0.128=0.054
min2.880-2.843=0.037
max3.323-3.150=0.173

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.194-1.546=-0.352
σ0.342-0.327=0.016
min0.918-1.170=-0.252
max1.773-1.868=-0.095

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.043-443.036=0.007
σ573.410-573.402=0.008
min156.336-156.333=0.003
max1303.158-1303.139=0.019
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1516.000=116.000
σ0.000
min1632.000-1516.000=116.000
max1632.000-1516.000=116.000
mean0.530-0.541=-0.010
σ0.540-0.555=-0.015
min0.255-0.259=-0.004
max1.341-1.374=-0.032
policies=20
mean1563.619-1563.599=0.020
σ0.353-0.325=0.028
min1563.409-1563.398=0.011
max1564.147-1564.084=0.063
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1516.000=116.000
σ0.000
min1632.000-1516.000=116.000
max1632.000-1516.000=116.000
mean2.646-2.599=0.046
σ0.046-0.019=0.027
min2.596-2.572=0.024
max2.707-2.614=0.092
policies=200
mean15644.065-15644.150=-0.085
σ0.140-0.178=-0.037
min15643.937-15643.958=-0.021
max15644.205-15644.370=-0.164
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1516.000=116.000
σ0.000
min1632.000-1516.000=116.000
max1632.000-1516.000=116.000
mean26.525-26.428=0.098
σ0.164-0.126=0.037
min26.386-26.280=0.106
max26.710-26.559=0.151