Compare commits

Home / Compare 296dde8a .. e5772325

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.822=0.001
σ0.365-0.366=-0.001
min53.678-53.680=-0.002
max54.861-54.864=-0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.140-0.138=0.003
σ0.003-0.005=-0.001
min0.136-0.132=0.004
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.209-43.209=-0.001
σ0.005-0.006=-0.001
min43.201-43.201=0.000
max43.217-43.221=-0.004
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.124-0.123=0.001
σ0.004-0.005=-0.001
min0.119-0.115=0.005
max0.130-0.132=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.179-1016.173=0.007
σ1.157-1.191=-0.034
min1015.608-1015.626=-0.018
max1021.012-1021.156=-0.144
mean1041.550-1047.100=-5.550
σ310.875-297.090=13.785
min587.000-588.000=-1.000
max1634.000-1467.000=167.000
mean1.553-1.562=-0.009
σ0.067-0.072=-0.005
min1.463-1.483=-0.021
max1.735-1.762=-0.027

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.594-301.346=0.248
σ0.273-0.199=0.073
min301.367-301.177=0.190
max302.333-301.895=0.438
mean1961.000-1949.000=12.000
σ0.000
min1961.000-1949.000=12.000
max1961.000-1949.000=12.000
mean0.552-0.542=0.009
σ0.035-0.040=-0.005
min0.496-0.482=0.014
max0.586-0.596=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.697-300.690=0.007
σ0.021-0.032=-0.010
min300.662-300.642=0.020
max300.718-300.720=-0.002
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean0.395-0.392=0.003
σ0.009-0.009=-0.001
min0.386-0.381=0.005
max0.405-0.402=0.003
iters=5
new-facts=1
prior-facts=6402
mean1322.858-1322.864=-0.006
σ0.106-0.100=0.006
min1322.785-1322.807=-0.022
max1323.045-1323.041=0.004
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean1.956-1.911=0.045
σ0.129-0.068=0.060
min1.810-1.813=-0.003
max2.146-1.996=0.150
iters=5
new-facts=6402
prior-facts=1
mean1561.305-1561.307=-0.002
σ6.871-6.884=-0.014
min1557.987-1557.973=0.014
max1573.589-1573.615=-0.026
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean2.344-2.335=0.010
σ0.264-0.261=0.003
min2.056-2.113=-0.057
max2.645-2.682=-0.037
iters=5
new-facts=6402
prior-facts=6402
mean1890.800-1890.798=0.002
σ0.032-0.016=0.016
min1890.782-1890.786=-0.004
max1890.856-1890.825=0.031
mean1790.800-1759.800=31.000
σ121.341-152.961=-31.620
min1634.000-1528.000=106.000
max1961.000-1949.000=12.000
mean3.045-2.972=0.073
σ0.151-0.105=0.046
min2.846-2.856=-0.009
max3.265-3.087=0.178

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.272-1.715=-0.443
σ0.328-0.126=0.202
min0.900-1.507=-0.607
max1.698-1.846=-0.148

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.047-443.030=0.017
σ573.411-573.395=0.016
min156.332-156.329=0.002
max1303.164-1303.123=0.041
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean0.546-0.560=-0.014
σ0.568-0.596=-0.029
min0.258-0.258=0.000
max1.397-1.454=-0.057
policies=20
mean1563.594-1563.574=0.020
σ0.326-0.318=0.008
min1563.408-1563.359=0.048
max1564.081-1564.047=0.035
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean2.616-2.603=0.013
σ0.009-0.013=-0.004
min2.608-2.590=0.017
max2.628-2.617=0.011
policies=200
mean15643.895-15643.332=0.564
σ0.045-0.313=-0.268
min15643.836-15643.000=0.836
max15643.935-15643.718=0.217
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean26.384-26.364=0.019
σ0.151-0.245=-0.094
min26.244-26.038=0.206
max26.566-26.633=-0.067