Compare commits

Home / Compare 66e5995e .. 7435ea9d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.834-53.837=-0.003
σ0.367-0.367=0.000
min53.692-53.686=0.006
max54.878-54.880=-0.003
mean415.700-415.000=0.700
σ0.483-0.000=0.483
min415.000
max416.000-415.000=1.000
mean0.139-0.140=-0.001
σ0.004-0.005=-0.001
min0.135-0.136=-0.001
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=-0.000
σ0.006-0.005=0.001
min43.201-43.202=-0.002
max43.220-43.219=0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.122-0.120=0.002
σ0.004-0.005=-0.001
min0.119-0.115=0.004
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.202-1016.203=-0.001
σ1.182-1.177=0.005
min1015.633-1015.640=-0.007
max1021.148-1021.125=0.023
mean1048.250-1047.950=0.300
σ311.284-311.364=-0.079
min556.000
max1512.000
mean1.538-1.543=-0.005
σ0.051-0.072=-0.021
min1.482-1.486=-0.004
max1.650-1.751=-0.101

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.184-301.131=0.053
σ0.231-0.246=-0.015
min300.999-300.970=0.029
max301.810-301.813=-0.003
mean2039.000-1945.000=94.000
σ0.000
min2039.000-1945.000=94.000
max2039.000-1945.000=94.000
mean0.574-0.545=0.029
σ0.017-0.031=-0.014
min0.540-0.505=0.035
max0.600-0.576=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.462-301.483=-0.021
σ0.076-0.048=0.028
min301.334-301.407=-0.073
max301.531-301.533=-0.002
mean1512.000
σ0.000
min1512.000
max1512.000
mean0.393-0.397=-0.003
σ0.009-0.007=0.002
min0.388-0.389=-0.000
max0.409-0.405=0.005
iters=5
new-facts=1
prior-facts=6402
mean1324.062-1324.055=0.008
σ0.113-0.107=0.006
min1323.926-1323.928=-0.002
max1324.212-1324.210=0.002
mean1512.000
σ0.000
min1512.000
max1512.000
mean1.880-1.965=-0.086
σ0.062-0.124=-0.062
min1.819-1.838=-0.019
max1.978-2.159=-0.181
iters=5
new-facts=6402
prior-facts=1
mean1562.066-1562.095=-0.029
σ6.898-6.931=-0.033
min1558.776-1558.746=0.030
max1574.399-1574.486=-0.087
mean1512.000
σ0.000
min1512.000
max1512.000
mean2.249-2.383=-0.134
σ0.198-0.318=-0.120
min2.040-2.068=-0.028
max2.486-2.831=-0.345
iters=5
new-facts=6402
prior-facts=6402
mean1891.973-1891.960=0.013
σ0.068-0.089=-0.021
min1891.854-1891.839=0.015
max1892.017-1892.041=-0.024
mean1742.800-1775.200=-32.400
σ222.605-161.484=61.121
min1512.000-1519.000=-7.000
max2039.000-1945.000=94.000
mean2.954-2.999=-0.045
σ0.110-0.174=-0.064
min2.862-2.865=-0.003
max3.103-3.292=-0.189

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.566-1.498=0.068
σ0.234-0.381=-0.147
min1.245-0.933=0.311
max1.776-1.786=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.688-443.689=-0.000
σ574.650-574.655=-0.005
min156.363-156.360=0.003
max1305.663-1305.671=-0.008
mean96.250
σ8.500
min92.000
max109.000
mean1512.000
σ0.000
min1512.000
max1512.000
mean0.555-0.530=0.025
σ0.585-0.536=0.049
min0.259-0.259=-0.000
max1.433-1.334=0.099
policies=20
mean1563.902-1563.889=0.013
σ0.341-0.338=0.002
min1563.680-1563.675=0.005
max1564.410-1564.394=0.016
mean920.000
σ0.000
min920.000
max920.000
mean1512.000
σ0.000
min1512.000
max1512.000
mean2.613-2.615=-0.002
σ0.009-0.003=0.006
min2.605-2.612=-0.007
max2.625-2.619=0.006
policies=200
mean15646.823-15646.944=-0.121
σ0.314-0.030=0.284
min15646.396-15646.911=-0.516
max15647.152-15646.972=0.181
mean9200.000
σ0.000
min9200.000
max9200.000
mean1512.000
σ0.000
min1512.000
max1512.000
mean26.386-26.428=-0.041
σ0.109-0.123=-0.014
min26.299-26.324=-0.025
max26.542-26.592=-0.050