Compare commits

Home / Compare 3eb0e1c5 .. 078f4b82

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.821=0.001
σ0.369-0.367=0.001
min53.676-53.677=-0.001
max54.871-54.866=0.005
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.139-0.137=0.003
σ0.003-0.005=-0.002
min0.136-0.131=0.005
max0.144-0.144=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.207-43.207=-0.000
σ0.007-0.006=0.001
min43.195-43.198=-0.004
max43.217-43.219=-0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.120-0.121=-0.001
σ0.005-0.004=0.001
min0.114-0.118=-0.004
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.178-1016.174=0.003
σ1.163-1.193=-0.030
min1015.629-1015.631=-0.002
max1021.041-1021.175=-0.134
mean1039.650-1050.900=-11.250
σ312.790-311.102=1.689
min572.000-559.000=13.000
max1636.000-1516.000=120.000
mean1.570-1.562=0.008
σ0.091-0.066=0.025
min1.489-1.501=-0.011
max1.817-1.756=0.060

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.330-301.403=-0.072
σ0.244-0.192=0.052
min301.202-301.260=-0.058
max302.013-301.929=0.084
mean1955.000-1947.000=8.000
σ0.000
min1955.000-1947.000=8.000
max1955.000-1947.000=8.000
mean0.547-0.556=-0.010
σ0.029-0.027=0.002
min0.499-0.504=-0.004
max0.573-0.581=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.699-300.707=-0.008
σ0.024-0.013=0.011
min300.668-300.691=-0.023
max300.731-300.723=0.007
mean1636.000-1516.000=120.000
σ0.000
min1636.000-1516.000=120.000
max1636.000-1516.000=120.000
mean0.400-0.396=0.004
σ0.008-0.005=0.002
min0.392-0.390=0.002
max0.409-0.400=0.009
iters=5
new-facts=1
prior-facts=6402
mean1322.863-1322.851=0.012
σ0.103-0.102=0.001
min1322.801-1322.760=0.041
max1323.047-1323.026=0.020
mean1636.000-1516.000=120.000
σ0.000
min1636.000-1516.000=120.000
max1636.000-1516.000=120.000
mean1.876-1.911=-0.034
σ0.048-0.040=0.007
min1.824-1.875=-0.051
max1.955-1.964=-0.010
iters=5
new-facts=6402
prior-facts=1
mean1561.353-1561.307=0.046
σ6.856-6.874=-0.018
min1557.959-1558.003=-0.044
max1573.609-1573.597=0.012
mean1636.000-1516.000=120.000
σ0.000
min1636.000-1516.000=120.000
max1636.000-1516.000=120.000
mean2.451-2.299=0.152
σ0.443-0.206=0.238
min2.140-2.088=0.052
max3.138-2.628=0.510
iters=5
new-facts=6402
prior-facts=6402
mean1890.805-1890.799=0.006
σ0.019-0.018=0.001
min1890.788-1890.779=0.009
max1890.835-1890.826=0.009
mean1784.400-1757.000=27.400
σ117.967-154.154=-36.187
min1636.000-1523.000=113.000
max1955.000-1947.000=8.000
mean3.011-2.948=0.063
σ0.176-0.156=0.020
min2.887-2.807=0.080
max3.313-3.210=0.103

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.275-1.569=-0.293
σ0.374-0.230=0.144
min0.904-1.221=-0.317
max1.817-1.806=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.045-443.037=0.009
σ573.414-573.404=0.010
min156.330-156.333=-0.004
max1303.166-1303.142=0.024
mean96.250
σ8.500
min92.000
max109.000
mean1636.000-1516.000=120.000
σ0.000
min1636.000-1516.000=120.000
max1636.000-1516.000=120.000
mean0.548-0.522=0.026
σ0.566-0.517=0.049
min0.260-0.261=-0.002
max1.396-1.297=0.099
policies=20
mean1563.625-1563.618=0.006
σ0.327-0.338=-0.011
min1563.423-1563.392=0.031
max1564.113-1564.121=-0.008
mean920.000
σ0.000
min920.000
max920.000
mean1636.000-1516.000=120.000
σ0.000
min1636.000-1516.000=120.000
max1636.000-1516.000=120.000
mean2.612-2.619=-0.006
σ0.007-0.017=-0.009
min2.604-2.605=-0.001
max2.621-2.641=-0.020
policies=200
mean15644.118-15644.060=0.057
σ0.081-0.081=0.000
min15644.007-15643.975=0.032
max15644.200-15644.149=0.051
mean9200.000
σ0.000
min9200.000
max9200.000
mean1636.000-1516.000=120.000
σ0.000
min1636.000-1516.000=120.000
max1636.000-1516.000=120.000
mean26.495-26.517=-0.022
σ0.156-0.097=0.059
min26.361-26.423=-0.062
max26.671-26.610=0.060