Compare commits

Home / Compare 7435ea9d .. b1f582d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.834=0.003
σ0.369-0.367=0.002
min53.689-53.692=-0.003
max54.886-54.878=0.009
mean416.000-415.700=0.300
σ0.000-0.483=-0.483
min416.000-415.000=1.000
max416.000
mean0.138-0.139=-0.001
σ0.004-0.004=0.000
min0.132-0.135=-0.003
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=0.000
σ0.007-0.006=0.001
min43.200-43.201=-0.001
max43.221-43.220=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.123-0.122=0.001
σ0.004-0.004=0.001
min0.119-0.119=-0.000
max0.129-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.204-1016.202=0.002
σ1.178-1.182=-0.003
min1015.659-1015.633=0.026
max1021.135-1021.148=-0.013
mean1048.650-1048.250=0.400
σ311.548-311.284=0.264
min556.000
max1513.000-1512.000=1.000
mean1.541-1.538=0.003
σ0.080-0.051=0.029
min1.419-1.482=-0.063
max1.745-1.650=0.095

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.336-301.184=0.151
σ0.269-0.231=0.038
min301.128-300.999=0.129
max302.067-301.810=0.257
mean2017.000-2039.000=-22.000
σ0.000
min2017.000-2039.000=-22.000
max2017.000-2039.000=-22.000
mean0.549-0.574=-0.024
σ0.030-0.017=0.013
min0.511-0.540=-0.029
max0.601-0.600=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.461-301.462=-0.001
σ0.063-0.076=-0.014
min301.368-301.334=0.034
max301.535-301.531=0.003
mean1513.000-1512.000=1.000
σ0.000
min1513.000-1512.000=1.000
max1513.000-1512.000=1.000
mean0.392-0.393=-0.001
σ0.003-0.009=-0.006
min0.389-0.388=0.001
max0.397-0.409=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1324.060-1324.062=-0.003
σ0.104-0.113=-0.009
min1323.930-1323.926=0.003
max1324.186-1324.212=-0.026
mean1513.000-1512.000=1.000
σ0.000
min1513.000-1512.000=1.000
max1513.000-1512.000=1.000
mean1.877-1.880=-0.003
σ0.057-0.062=-0.005
min1.821-1.819=0.002
max1.966-1.978=-0.013
iters=5
new-facts=6402
prior-facts=1
mean1562.086-1562.066=0.020
σ6.892-6.898=-0.006
min1558.814-1558.776=0.038
max1574.410-1574.399=0.011
mean1513.000-1512.000=1.000
σ0.000
min1513.000-1512.000=1.000
max1513.000-1512.000=1.000
mean2.330-2.249=0.081
σ0.314-0.198=0.115
min2.022-2.040=-0.018
max2.726-2.486=0.240
iters=5
new-facts=6402
prior-facts=6402
mean1891.982-1891.973=0.009
σ0.034-0.068=-0.035
min1891.925-1891.854=0.072
max1892.009-1892.017=-0.008
mean1735.800-1742.800=-7.000
σ209.995-222.605=-12.611
min1513.000-1512.000=1.000
max2017.000-2039.000=-22.000
mean2.920-2.954=-0.034
σ0.093-0.110=-0.017
min2.871-2.862=0.009
max3.086-3.103=-0.017

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.533-1.566=-0.033
σ0.291-0.234=0.057
min1.212-1.245=-0.033
max1.772-1.776=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.692-443.688=0.004
σ574.652-574.650=0.002
min156.362-156.363=-0.001
max1305.671-1305.663=0.008
mean96.250
σ8.500
min92.000
max109.000
mean1513.000-1512.000=1.000
σ0.000
min1513.000-1512.000=1.000
max1513.000-1512.000=1.000
mean0.531-0.555=-0.024
σ0.530-0.585=-0.055
min0.263-0.259=0.004
max1.326-1.433=-0.107
policies=20
mean1563.901-1563.902=-0.001
σ0.331-0.341=-0.009
min1563.683-1563.680=0.003
max1564.394-1564.410=-0.015
mean920.000
σ0.000
min920.000
max920.000
mean1513.000-1512.000=1.000
σ0.000
min1513.000-1512.000=1.000
max1513.000-1512.000=1.000
mean2.607-2.613=-0.006
σ0.005-0.009=-0.004
min2.602-2.605=-0.004
max2.613-2.625=-0.012
policies=200
mean15646.911-15646.823=0.088
σ0.137-0.314=-0.177
min15646.793-15646.396=0.397
max15647.109-15647.152=-0.043
mean9200.000
σ0.000
min9200.000
max9200.000
mean1513.000-1512.000=1.000
σ0.000
min1513.000-1512.000=1.000
max1513.000-1512.000=1.000
mean26.453-26.386=0.067
σ0.142-0.109=0.032
min26.289-26.299=-0.011
max26.585-26.542=0.043