Compare commits

Home / Compare 3437b99d .. 5f417442

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.049-53.821=0.228
σ0.370-0.366=0.003
min53.912-53.674=0.237
max55.100-54.863=0.237
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.139-0.138=0.000
σ0.003-0.004=-0.001
min0.136-0.134=0.002
max0.144-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.341-43.209=0.132
σ0.007-0.005=0.002
min43.331-43.203=0.128
max43.357-43.217=0.140
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.120-0.120=-0.000
σ0.005-0.003=0.002
min0.115-0.118=-0.003
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.195-1016.174=1.021
σ1.229-1.178=0.051
min1016.664-1015.600=1.064
max1022.356-1021.104=1.252
mean1057.050-1045.500=11.550
σ316.708-311.949=4.759
min559.000-553.000=6.000
max1516.000-1512.000=4.000
mean1.571-1.547=0.024
σ0.142-0.053=0.089
min1.473-1.494=-0.020
max2.101-1.674=0.427

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.922-301.269=0.654
σ0.256-0.269=-0.014
min301.760-301.111=0.648
max302.626-302.006=0.620
mean2097.000-1953.000=144.000
σ0.000
min2097.000-1953.000=144.000
max2097.000-1953.000=144.000
mean0.566-0.544=0.022
σ0.042-0.033=0.009
min0.501-0.509=-0.008
max0.626-0.594=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.778-300.704=3.074
σ0.059-0.013=0.046
min303.688-300.689=3.000
max303.841-300.718=3.122
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean0.395-0.395=-0.001
σ0.009-0.007=0.001
min0.389-0.387=0.002
max0.410-0.404=0.006
iters=5
new-facts=1
prior-facts=6402
mean1326.333-1322.849=3.484
σ0.107-0.093=0.014
min1326.198-1322.764=3.434
max1326.462-1323.008=3.453
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean1.935-1.907=0.028
σ0.095-0.024=0.072
min1.830-1.873=-0.043
max2.039-1.939=0.100
iters=5
new-facts=6402
prior-facts=1
mean1564.374-1561.295=3.079
σ6.898-6.869=0.029
min1561.084-1558.001=3.082
max1576.709-1573.578=3.132
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean2.306-2.301=0.005
σ0.280-0.243=0.037
min2.026-2.105=-0.079
max2.679-2.697=-0.019
iters=5
new-facts=6402
prior-facts=6402
mean1894.273-1890.799=3.474
σ0.061-0.025=0.036
min1894.169-1890.782=3.387
max1894.319-1890.843=3.476
mean1751.400-1761.600=-10.200
σ236.757-155.457=81.300
min1516.000-1527.000=-11.000
max2097.000-1953.000=144.000
mean2.953-3.008=-0.055
σ0.123-0.174=-0.052
min2.868-2.876=-0.009
max3.156-3.289=-0.134

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.550-1.415=0.134
σ0.306-0.319=-0.013
min1.187-0.938=0.250
max1.858-1.690=0.168

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.329-443.042=5.287
σ581.790-573.414=8.376
min157.430-156.329=1.100
max1321.014-1303.163=17.851
mean96.250
σ8.500
min92.000
max109.000
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean0.547-0.541=0.005
σ0.561-0.560=0.001
min0.261-0.258=0.003
max1.388-1.381=0.007
policies=20
mean1574.573-1563.585=10.988
σ0.342-0.338=0.005
min1574.346-1563.357=10.989
max1575.082-1564.087=10.995
mean920.000
σ0.000
min920.000
max920.000
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean2.620-2.612=0.008
σ0.019-0.007=0.012
min2.600-2.606=-0.006
max2.641-2.621=0.020
policies=200
mean15754.001-15643.791=110.210
σ0.065-0.056=0.010
min15753.949-15643.712=110.237
max15754.093-15643.838=110.255
mean9200.000
σ0.000
min9200.000
max9200.000
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean26.649-26.455=0.194
σ0.303-0.173=0.130
min26.472-26.302=0.170
max27.102-26.632=0.470