Compare commits

Home / Compare 1c85ac67 .. c3d17932

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.836=-0.001
σ0.370-0.367=0.003
min53.689-53.695=-0.006
max54.889-54.880=0.009
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.138-0.138=-0.000
σ0.005-0.005=-0.000
min0.131-0.131=0.001
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.208-43.207=0.001
σ0.007-0.005=0.002
min43.193-43.199=-0.005
max43.219-43.218=0.001
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.122-0.121=0.000
σ0.003-0.004=-0.001
min0.118-0.114=0.004
max0.128-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.205-1016.209=-0.005
σ1.167-1.140=0.026
min1015.641-1015.632=0.009
max1021.088-1020.968=0.120
mean1043.000-1040.050=2.950
σ310.267-310.358=-0.091
min589.000-587.000=2.000
max1629.000-1627.000=2.000
mean1.527-1.541=-0.014
σ0.072-0.104=-0.033
min1.455-1.439=0.015
max1.764-1.792=-0.028

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.391-301.365=0.025
σ0.203-0.254=-0.052
min301.245-301.192=0.053
max301.943-302.065=-0.122
mean2031.000-1956.000=75.000
σ0.000
min2031.000-1956.000=75.000
max2031.000-1956.000=75.000
mean0.532-0.558=-0.025
σ0.032-0.035=-0.003
min0.507-0.509=-0.003
max0.579-0.596=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.710-300.717=-0.008
σ0.061-0.034=0.028
min300.602-300.662=-0.060
max300.748-300.748=0.000
mean1629.000-1627.000=2.000
σ0.000
min1629.000-1627.000=2.000
max1629.000-1627.000=2.000
mean0.409-0.395=0.014
σ0.013-0.007=0.006
min0.391-0.388=0.003
max0.426-0.404=0.022
iters=5
new-facts=1
prior-facts=6402
mean1322.885-1322.889=-0.003
σ0.091-0.103=-0.011
min1322.836-1322.826=0.010
max1323.048-1323.070=-0.023
mean1629.000-1627.000=2.000
σ0.000
min1629.000-1627.000=2.000
max1629.000-1627.000=2.000
mean1.945-1.948=-0.004
σ0.103-0.077=0.026
min1.842-1.846=-0.004
max2.051-2.031=0.019
iters=5
new-facts=6402
prior-facts=1
mean1561.352-1561.331=0.021
σ6.861-6.904=-0.044
min1558.065-1557.997=0.068
max1573.620-1573.676=-0.056
mean1629.000-1627.000=2.000
σ0.000
min1629.000-1627.000=2.000
max1629.000-1627.000=2.000
mean2.310-2.274=0.036
σ0.165-0.258=-0.093
min2.066-2.062=0.004
max2.451-2.716=-0.265
iters=5
new-facts=6402
prior-facts=6402
mean1890.809-1890.824=-0.015
σ0.012-0.018=-0.006
min1890.792-1890.808=-0.015
max1890.824-1890.852=-0.028
mean1770.800-1782.400=-11.600
σ172.694-119.331=53.363
min1629.000-1627.000=2.000
max2031.000-1956.000=75.000
mean2.910-2.949=-0.039
σ0.063-0.060=0.003
min2.865-2.881=-0.016
max3.022-3.034=-0.013

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.167-1.229=-0.063
σ0.283-0.286=-0.003
min0.916-1.027=-0.111
max1.603-1.692=-0.089

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.490-443.489=0.001
σ574.245-574.237=0.008
min156.364-156.364=0.000
max1304.858-1304.845=0.013
mean96.250
σ8.500
min92.000
max109.000
mean1629.000-1627.000=2.000
σ0.000
min1629.000-1627.000=2.000
max1629.000-1627.000=2.000
mean0.542-0.537=0.005
σ0.564-0.554=0.010
min0.259-0.257=0.001
max1.388-1.368=0.020
policies=20
mean1563.928-1563.915=0.014
σ0.336-0.323=0.014
min1563.745-1563.726=0.019
max1564.432-1564.398=0.035
mean920.000
σ0.000
min920.000
max920.000
mean1629.000-1627.000=2.000
σ0.000
min1629.000-1627.000=2.000
max1629.000-1627.000=2.000
mean2.639-2.610=0.030
σ0.062-0.022=0.040
min2.601-2.586=0.015
max2.731-2.638=0.093
policies=200
mean15647.015-15646.946=0.070
σ0.082-0.065=0.017
min15646.957-15646.853=0.104
max15647.137-15646.999=0.138
mean9200.000
σ0.000
min9200.000
max9200.000
mean1629.000-1627.000=2.000
σ0.000
min1629.000-1627.000=2.000
max1629.000-1627.000=2.000
mean26.403-26.427=-0.024
σ0.168-0.182=-0.014
min26.212-26.242=-0.030
max26.564-26.617=-0.054