Compare commits

Home / Compare 57100ca2 .. ffa6707f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.823=0.000
σ0.369-0.368=0.001
min53.676-53.679=-0.004
max54.873-54.869=0.004
mean417.700-414.000=3.700
σ0.483-0.000=0.483
min417.000-414.000=3.000
max418.000-414.000=4.000
mean0.137-0.138=-0.001
σ0.004-0.004=-0.000
min0.131-0.132=-0.001
max0.143-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.209-43.207=0.002
σ0.006-0.006=0.000
min43.199-43.200=-0.001
max43.216-43.217=-0.001
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.120-0.122=-0.002
σ0.001-0.003=-0.002
min0.119-0.119=0.000
max0.124-0.128=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.177-1016.176=0.001
σ1.177-1.175=0.003
min1015.613-1015.611=0.002
max1021.102-1021.098=0.005
mean1051.050-1041.050=10.000
σ312.089-311.483=0.606
min558.000-586.000=-28.000
max1517.000-1633.000=-116.000
mean1.554-1.567=-0.014
σ0.057-0.095=-0.038
min1.479-1.493=-0.014
max1.669-1.841=-0.172

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.317-301.554=-0.238
σ0.180-0.207=-0.027
min301.139-301.393=-0.254
max301.748-302.128=-0.379
mean2033.000-2034.000=-1.000
σ0.000
min2033.000-2034.000=-1.000
max2033.000-2034.000=-1.000
mean0.559-0.561=-0.002
σ0.030-0.044=-0.014
min0.497-0.502=-0.005
max0.582-0.603=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.705-300.698=0.007
σ0.019-0.021=-0.002
min300.688-300.669=0.018
max300.735-300.722=0.013
mean1517.000-1633.000=-116.000
σ0.000
min1517.000-1633.000=-116.000
max1517.000-1633.000=-116.000
mean0.398-0.396=0.001
σ0.008-0.008=0.000
min0.388-0.388=0.001
max0.405-0.407=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1322.868-1322.864=0.004
σ0.091-0.105=-0.015
min1322.817-1322.802=0.015
max1323.028-1323.051=-0.024
mean1517.000-1633.000=-116.000
σ0.000
min1517.000-1633.000=-116.000
max1517.000-1633.000=-116.000
mean1.927-1.856=0.071
σ0.126-0.063=0.063
min1.797-1.796=0.001
max2.092-1.943=0.149
iters=5
new-facts=6402
prior-facts=1
mean1561.321-1561.297=0.025
σ6.908-6.863=0.046
min1557.964-1557.955=0.009
max1573.673-1573.566=0.107
mean1517.000-1633.000=-116.000
σ0.000
min1517.000-1633.000=-116.000
max1517.000-1633.000=-116.000
mean2.357-2.331=0.026
σ0.334-0.261=0.073
min1.995-2.067=-0.072
max2.871-2.689=0.183
iters=5
new-facts=6402
prior-facts=6402
mean1890.774-1890.803=-0.029
σ0.034-0.034=0.000
min1890.723-1890.782=-0.059
max1890.816-1890.863=-0.047
mean1736.200-1779.400=-43.200
σ212.267-163.725=48.542
min1517.000-1633.000=-116.000
max2033.000-2034.000=-1.000
mean2.907-2.916=-0.009
σ0.157-0.083=0.074
min2.692-2.798=-0.106
max3.136-2.996=0.140

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.509-1.250=0.259
σ0.156-0.300=-0.144
min1.327-0.912=0.415
max1.747-1.634=0.113

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.040-443.046=-0.006
σ573.406-573.413=-0.006
min156.332-156.333=-0.001
max1303.150-1303.165=-0.016
mean96.250
σ8.500
min92.000
max109.000
mean1517.000-1633.000=-116.000
σ0.000
min1517.000-1633.000=-116.000
max1517.000-1633.000=-116.000
mean0.524-0.532=-0.008
σ0.515-0.535=-0.020
min0.264-0.259=0.005
max1.296-1.335=-0.039
policies=20
mean1563.607-1563.594=0.013
σ0.340-0.339=0.002
min1563.391-1563.383=0.008
max1564.114-1564.099=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1517.000-1633.000=-116.000
σ0.000
min1517.000-1633.000=-116.000
max1517.000-1633.000=-116.000
mean2.619-2.628=-0.010
σ0.017-0.027=-0.010
min2.593-2.606=-0.013
max2.632-2.668=-0.036
policies=200
mean15643.852-15643.881=-0.029
σ0.118-0.039=0.078
min15643.737-15643.823=-0.086
max15644.002-15643.908=0.094
mean9200.000
σ0.000
min9200.000
max9200.000
mean1517.000-1633.000=-116.000
σ0.000
min1517.000-1633.000=-116.000
max1517.000-1633.000=-116.000
mean26.488-26.497=-0.008
σ0.165-0.210=-0.044
min26.283-26.269=0.014
max26.670-26.705=-0.034