Compare commits

Home / Compare df95bdf9 .. a6b81b21

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.835=0.000
σ0.366-0.367=-0.001
min53.691-53.689=0.002
max54.877-54.879=-0.002
mean419.000-421.000=-2.000
σ0.000
min419.000-421.000=-2.000
max419.000-421.000=-2.000
mean0.139-0.138=0.000
σ0.004-0.004=-0.000
min0.135-0.133=0.002
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.206-43.208=-0.001
σ0.005-0.004=0.001
min43.199-43.202=-0.002
max43.214-43.214=0.000
mean419.000-421.000=-2.000
σ0.000
min419.000-421.000=-2.000
max419.000-421.000=-2.000
mean0.116-0.122=-0.006
σ0.003-0.004=-0.001
min0.113-0.118=-0.005
max0.121-0.129=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.205-1016.207=-0.002
σ1.190-1.164=0.026
min1015.659-1015.632=0.027
max1021.198-1021.081=0.117
mean1045.150-1071.550=-26.400
σ293.444-308.544=-15.101
min606.000-609.000=-3.000
max1432.000-1548.000=-116.000
mean1.536-1.516=0.020
σ0.102-0.082=0.020
min1.442-1.308=0.134
max1.771-1.664=0.107

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.420-301.169=0.251
σ0.302-0.217=0.085
min301.149-301.024=0.125
max302.175-301.739=0.436
mean2029.000-1949.000=80.000
σ0.000
min2029.000-1949.000=80.000
max2029.000-1949.000=80.000
mean0.560-0.572=-0.012
σ0.031-0.018=0.013
min0.507-0.538=-0.031
max0.602-0.602=0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.490-301.483=0.007
σ0.034-0.041=-0.007
min301.456-301.424=0.032
max301.535-301.521=0.014
mean1432.000-1548.000=-116.000
σ0.000
min1432.000-1548.000=-116.000
max1432.000-1548.000=-116.000
mean0.393-0.397=-0.003
σ0.007-0.006=0.001
min0.389-0.391=-0.002
max0.406-0.404=0.001
iters=5
new-facts=1
prior-facts=6402
mean1324.066-1324.057=0.009
σ0.115-0.101=0.013
min1323.928-1323.931=-0.003
max1324.204-1324.199=0.005
mean1432.000-1548.000=-116.000
σ0.000
min1432.000-1548.000=-116.000
max1432.000-1548.000=-116.000
mean1.906-1.958=-0.052
σ0.063-0.162=-0.099
min1.840-1.732=0.108
max1.986-2.153=-0.168
iters=5
new-facts=6402
prior-facts=1
mean1562.050-1562.100=-0.050
σ6.906-6.926=-0.020
min1558.719-1558.761=-0.042
max1574.398-1574.483=-0.085
mean1432.000-1548.000=-116.000
σ0.000
min1432.000-1548.000=-116.000
max1432.000-1548.000=-116.000
mean2.183-2.380=-0.196
σ0.168-0.263=-0.095
min2.098-2.081=0.016
max2.483-2.765=-0.282
iters=5
new-facts=6402
prior-facts=6402
mean1891.949-1891.961=-0.012
σ0.067-0.082=-0.016
min1891.857-1891.848=0.009
max1892.011-1892.033=-0.021
mean1721.200-1785.200=-64.000
σ237.503-151.971=85.532
min1432.000-1548.000=-116.000
max2029.000-1949.000=80.000
mean2.934-2.963=-0.029
σ0.119-0.159=-0.040
min2.866-2.792=0.074
max3.147-3.218=-0.071

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.724-1.550=0.174
σ0.091-0.338=-0.247
min1.612-1.126=0.486
max1.827-1.891=-0.065

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.474-443.482=-0.008
σ574.226-574.235=-0.009
min156.358-156.364=-0.006
max1304.814-1304.835=-0.021
mean96.250
σ8.500
min92.000
max109.000
mean1432.000-1548.000=-116.000
σ0.000
min1432.000-1548.000=-116.000
max1432.000-1548.000=-116.000
mean0.547-0.541=0.006
σ0.563-0.563=-0.001
min0.262-0.259=0.003
max1.391-1.386=0.005
policies=20
mean1563.904-1563.897=0.007
σ0.332-0.328=0.004
min1563.685-1563.698=-0.013
max1564.399-1564.388=0.010
mean920.000
σ0.000
min920.000
max920.000
mean1432.000-1548.000=-116.000
σ0.000
min1432.000-1548.000=-116.000
max1432.000-1548.000=-116.000
mean2.610-2.612=-0.002
σ0.013-0.020=-0.007
min2.593-2.588=0.005
max2.622-2.636=-0.014
policies=200
mean15646.935-15646.914=0.021
σ0.038-0.068=-0.030
min15646.883-15646.813=0.070
max15646.970-15646.951=0.018
mean9200.000
σ0.000
min9200.000
max9200.000
mean1432.000-1548.000=-116.000
σ0.000
min1432.000-1548.000=-116.000
max1432.000-1548.000=-116.000
mean26.444-26.407=0.037
σ0.136-0.150=-0.015
min26.267-26.275=-0.008
max26.559-26.573=-0.014