Compare commits

Home / Compare 5a7ae87a .. ba42a1c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.835=0.002
σ0.366-0.368=-0.002
min53.701-53.692=0.009
max54.879-54.882=-0.003
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.139-0.138=0.001
σ0.004-0.003=0.001
min0.135-0.135=0.000
max0.145-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=0.000
σ0.007-0.006=0.002
min43.200-43.199=0.001
max43.223-43.221=0.003
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.120-0.121=-0.001
σ0.004-0.003=0.001
min0.114-0.118=-0.004
max0.125-0.127=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.204-1016.206=-0.002
σ1.157-1.157=-0.000
min1015.630-1015.632=-0.002
max1021.045-1021.047=-0.001
mean1042.900-1042.150=0.750
σ310.326-297.262=13.064
min590.000-583.000=7.000
max1628.000-1460.000=168.000
mean1.547-1.523=0.025
σ0.089-0.061=0.028
min1.474-1.384=0.090
max1.782-1.622=0.160

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.277-301.170=0.107
σ0.260-0.234=0.026
min301.044-301.006=0.039
max301.976-301.815=0.161
mean2013.000-2031.000=-18.000
σ0.000
min2013.000-2031.000=-18.000
max2013.000-2031.000=-18.000
mean0.553-0.551=0.002
σ0.034-0.039=-0.005
min0.499-0.497=0.001
max0.585-0.603=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.488-301.485=0.003
σ0.031-0.047=-0.016
min301.449-301.417=0.032
max301.528-301.536=-0.008
mean1628.000-1460.000=168.000
σ0.000
min1628.000-1460.000=168.000
max1628.000-1460.000=168.000
mean0.394-0.391=0.002
σ0.004-0.001=0.002
min0.390-0.390=-0.000
max0.398-0.392=0.006
iters=5
new-facts=1
prior-facts=6402
mean1324.075-1324.061=0.014
σ0.122-0.110=0.012
min1323.926-1323.921=0.005
max1324.218-1324.188=0.031
mean1628.000-1460.000=168.000
σ0.000
min1628.000-1460.000=168.000
max1628.000-1460.000=168.000
mean1.901-1.920=-0.019
σ0.128-0.083=0.045
min1.823-1.831=-0.007
max2.128-2.025=0.103
iters=5
new-facts=6402
prior-facts=1
mean1562.087-1562.158=-0.071
σ6.935-6.896=0.038
min1558.727-1558.899=-0.173
max1574.485-1574.490=-0.005
mean1628.000-1460.000=168.000
σ0.000
min1628.000-1460.000=168.000
max1628.000-1460.000=168.000
mean2.354-2.490=-0.136
σ0.323-0.320=0.003
min2.042-2.046=-0.003
max2.848-2.845=0.003
iters=5
new-facts=6402
prior-facts=6402
mean1891.974-1891.968=0.006
σ0.066-0.059=0.007
min1891.857-1891.867=-0.011
max1892.010-1892.017=-0.007
mean1762.200-1721.800=40.400
σ167.238-232.787=-65.548
min1628.000-1460.000=168.000
max2013.000-2031.000=-18.000
mean2.970-2.934=0.036
σ0.215-0.111=0.104
min2.864-2.864=0.000
max3.354-3.130=0.224

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.183-1.755=-0.573
σ0.381-0.026=0.355
min0.907-1.717=-0.811
max1.825-1.790=0.035

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.486-443.474=0.012
σ574.248-574.221=0.027
min156.357
max1304.858-1304.806=0.053
mean96.250
σ8.500
min92.000
max109.000
mean1628.000-1460.000=168.000
σ0.000
min1628.000-1460.000=168.000
max1628.000-1460.000=168.000
mean0.548-0.534=0.014
σ0.563-0.546=0.017
min0.262-0.259=0.003
max1.392-1.353=0.040
policies=20
mean1563.910-1563.906=0.004
σ0.329-0.343=-0.014
min1563.734-1563.682=0.052
max1564.404-1564.417=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1628.000-1460.000=168.000
σ0.000
min1628.000-1460.000=168.000
max1628.000-1460.000=168.000
mean2.621-2.630=-0.009
σ0.014-0.034=-0.020
min2.602-2.598=0.004
max2.636-2.679=-0.043
policies=200
mean15646.930-15647.036=-0.106
σ0.050-0.060=-0.009
min15646.861-15646.971=-0.110
max15646.972-15647.104=-0.131
mean9200.000
σ0.000
min9200.000
max9200.000
mean1628.000-1460.000=168.000
σ0.000
min1628.000-1460.000=168.000
max1628.000-1460.000=168.000
mean26.539-26.512=0.028
σ0.124-0.243=-0.118
min26.407-26.263=0.144
max26.686-26.845=-0.159