Compare commits

Home / Compare 063f43d4 .. 4bcb5bc6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.824-53.822=0.002
σ0.369-0.368=0.000
min53.682-53.676=0.007
max54.873-54.870=0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.139-0.137=0.002
σ0.004-0.005=-0.001
min0.136-0.130=0.006
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.207-43.208=-0.001
σ0.007-0.007=0.000
min43.196-43.198=-0.002
max43.221-43.220=0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.120-0.122=-0.002
σ0.004-0.003=0.001
min0.114-0.120=-0.006
max0.126-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.174-1016.179=-0.005
σ1.173-1.170=0.003
min1015.633-1015.606=0.027
max1021.091-1021.078=0.013
mean1046.650-1046.750=-0.100
σ312.505-299.342=13.163
min551.000-577.000=-26.000
max1659.000-1458.000=201.000
mean1.616-1.569=0.047
σ0.135-0.073=0.062
min1.505-1.470=0.035
max2.056-1.718=0.338

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.194-301.219=-0.025
σ0.224-0.258=-0.034
min301.038-300.898=0.140
max301.804-301.768=0.036
mean2030.000-1950.000=80.000
σ0.000
min2030.000-1950.000=80.000
max2030.000-1950.000=80.000
mean0.567-0.551=0.016
σ0.039-0.024=0.015
min0.508-0.497=0.011
max0.602-0.575=0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.700-300.699=0.001
σ0.024-0.026=-0.002
min300.669-300.668=0.001
max300.732-300.737=-0.005
mean1659.000-1458.000=201.000
σ0.000
min1659.000-1458.000=201.000
max1659.000-1458.000=201.000
mean0.397-0.398=-0.000
σ0.007-0.009=-0.002
min0.389-0.388=0.001
max0.403-0.408=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1322.866-1322.864=0.003
σ0.098-0.101=-0.004
min1322.813-1322.797=0.016
max1323.040-1323.044=-0.004
mean1659.000-1458.000=201.000
σ0.000
min1659.000-1458.000=201.000
max1659.000-1458.000=201.000
mean1.934-1.958=-0.023
σ0.118-0.119=-0.002
min1.815-1.832=-0.017
max2.082-2.154=-0.072
iters=5
new-facts=6402
prior-facts=1
mean1561.296-1561.318=-0.022
σ6.887-6.888=-0.000
min1557.972-1557.977=-0.006
max1573.611-1573.631=-0.020
mean1659.000-1458.000=201.000
σ0.000
min1659.000-1458.000=201.000
max1659.000-1458.000=201.000
mean2.244-2.405=-0.161
σ0.224-0.347=-0.123
min2.106-2.090=0.016
max2.639-2.926=-0.287
iters=5
new-facts=6402
prior-facts=6402
mean1890.782-1890.801=-0.019
σ0.021-0.026=-0.005
min1890.761-1890.778=-0.017
max1890.816-1890.844=-0.028
mean1782.400-1760.400=22.000
σ160.477-154.780=5.697
min1659.000-1526.000=133.000
max2030.000-1950.000=80.000
mean2.943-2.997=-0.054
σ0.086-0.177=-0.091
min2.876-2.851=0.025
max3.091-3.286=-0.196

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.111-1.678=-0.568
σ0.292-0.187=0.106
min0.916-1.390=-0.474
max1.575-1.830=-0.255

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.042-443.036=0.006
σ573.406-573.402=0.004
min156.334-156.328=0.006
max1303.151-1303.139=0.011
mean96.250
σ8.500
min92.000
max109.000
mean1659.000-1458.000=201.000
σ0.000
min1659.000-1458.000=201.000
max1659.000-1458.000=201.000
mean0.546-0.527=0.019
σ0.572-0.530=0.042
min0.259-0.259=0.000
max1.404-1.322=0.083
policies=20
mean1563.628-1563.613=0.015
σ0.332-0.346=-0.013
min1563.432-1563.383=0.049
max1564.125-1564.128=-0.003
mean920.000
σ0.000
min920.000
max920.000
mean1659.000-1458.000=201.000
σ0.000
min1659.000-1458.000=201.000
max1659.000-1458.000=201.000
mean2.617-2.619=-0.003
σ0.017-0.017=-0.000
min2.599-2.598=0.001
max2.636-2.640=-0.004
policies=200
mean15644.155-15644.038=0.117
σ0.068-0.056=0.013
min15644.067-15643.986=0.080
max15644.232-15644.086=0.146
mean9200.000
σ0.000
min9200.000
max9200.000
mean1659.000-1458.000=201.000
σ0.000
min1659.000-1458.000=201.000
max1659.000-1458.000=201.000
mean26.545-26.411=0.134
σ0.173-0.146=0.027
min26.382-26.320=0.062
max26.752-26.627=0.125