Compare commits

Home / Compare eaa13a15 .. 5a01b1e1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.822=0.001
σ0.370-0.369=0.002
min53.677-53.673=0.003
max54.876-54.871=0.006
mean419.000-417.000=2.000
σ0.000
min419.000-417.000=2.000
max419.000-417.000=2.000
mean0.138-0.135=0.003
σ0.003-0.005=-0.001
min0.135-0.130=0.005
max0.144-0.142=0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.206=0.002
σ0.007-0.006=0.001
min43.199-43.197=0.001
max43.220-43.214=0.006
mean419.000-417.000=2.000
σ0.000
min419.000-417.000=2.000
max419.000-417.000=2.000
mean0.120-0.117=0.003
σ0.003-0.004=-0.001
min0.117-0.114=0.003
max0.126-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.179-1016.175=0.004
σ1.174-1.181=-0.007
min1015.604-1015.613=-0.009
max1021.098-1021.123=-0.026
mean1052.750-1049.700=3.050
σ296.828-310.063=-13.235
min581.000-564.000=17.000
max1449.000-1512.000=-63.000
mean1.521-1.537=-0.017
σ0.067-0.064=0.003
min1.462-1.485=-0.023
max1.695-1.731=-0.036

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.454-301.469=-0.014
σ0.308-0.236=0.072
min301.146-301.209=-0.063
max302.200-302.031=0.169
mean2043.000-1965.000=78.000
σ0.000
min2043.000-1965.000=78.000
max2043.000-1965.000=78.000
mean0.571-0.560=0.012
σ0.026-0.044=-0.018
min0.519-0.496=0.023
max0.603-0.605=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.684-300.698=-0.014
σ0.046-0.035=0.012
min300.603-300.655=-0.052
max300.715-300.746=-0.031
mean1449.000-1512.000=-63.000
σ0.000
min1449.000-1512.000=-63.000
max1449.000-1512.000=-63.000
mean0.397-0.398=-0.001
σ0.007-0.014=-0.007
min0.389-0.389=-0.000
max0.403-0.422=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1322.879-1322.865=0.014
σ0.097-0.098=-0.001
min1322.812-1322.810=0.002
max1323.044-1323.041=0.004
mean1449.000-1512.000=-63.000
σ0.000
min1449.000-1512.000=-63.000
max1449.000-1512.000=-63.000
mean1.847-1.930=-0.084
σ0.036-0.122=-0.087
min1.799-1.828=-0.029
max1.895-2.142=-0.247
iters=5
new-facts=6402
prior-facts=1
mean1561.319-1561.316=0.003
σ6.908-6.907=0.001
min1558.014-1557.986=0.028
max1573.671-1573.664=0.008
mean1449.000-1512.000=-63.000
σ0.000
min1449.000-1512.000=-63.000
max1449.000-1512.000=-63.000
mean2.372-2.353=0.019
σ0.401-0.361=0.040
min1.995-2.008=-0.013
max2.912-2.846=0.066
iters=5
new-facts=6402
prior-facts=6402
mean1890.793-1890.803=-0.010
σ0.025-0.026=-0.001
min1890.765-1890.787=-0.023
max1890.826-1890.849=-0.023
mean1730.600-1774.200=-43.600
σ237.525-158.768=78.758
min1449.000-1533.000=-84.000
max2043.000-1965.000=78.000
mean2.917-2.979=-0.062
σ0.113-0.219=-0.106
min2.864-2.707=0.157
max3.119-3.300=-0.181

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.712-1.565=0.146
σ0.101-0.327=-0.226
min1.538-1.208=0.330
max1.789-1.876=-0.087

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.322-443.327=-0.006
σ573.971-573.977=-0.006
min156.329-156.335=-0.006
max1304.279-1304.293=-0.014
mean96.250
σ8.500
min92.000
max109.000
mean1449.000-1512.000=-63.000
σ0.000
min1449.000-1512.000=-63.000
max1449.000-1512.000=-63.000
mean0.538-0.539=-0.001
σ0.554-0.556=-0.003
min0.260-0.258=0.002
max1.368-1.374=-0.006
policies=20
mean1563.616-1563.593=0.023
σ0.340-0.334=0.006
min1563.397-1563.391=0.006
max1564.124-1564.093=0.031
mean920.000
σ0.000
min920.000
max920.000
mean1449.000-1512.000=-63.000
σ0.000
min1449.000-1512.000=-63.000
max1449.000-1512.000=-63.000
mean2.624-2.613=0.012
σ0.050-0.012=0.038
min2.578-2.598=-0.020
max2.696-2.627=0.069
policies=200
mean15644.036-15644.078=-0.042
σ0.100-0.136=-0.035
min15643.915-15643.954=-0.040
max15644.124-15644.230=-0.106
mean9200.000
σ0.000
min9200.000
max9200.000
mean1449.000-1512.000=-63.000
σ0.000
min1449.000-1512.000=-63.000
max1449.000-1512.000=-63.000
mean26.394-26.452=-0.058
σ0.130-0.163=-0.033
min26.291-26.312=-0.021
max26.564-26.652=-0.088