Compare commits

Home / Compare 6b7aa5d4 .. a066bb1d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.073-54.076=-0.003
σ0.367-0.369=-0.002
min53.928-53.934=-0.005
max55.117-55.126=-0.009
mean417.000
σ0.000
min417.000
max417.000
mean0.140-0.146=-0.006
σ0.004-0.009=-0.006
min0.136-0.138=-0.002
max0.146-0.165=-0.019
cache=y
dps=1
iters=10
policies=100
mean43.399-43.398=0.000
σ0.006-0.008=-0.001
min43.390-43.387=0.003
max43.407-43.416=-0.009
mean417.000
σ0.000
min417.000
max417.000
mean0.121-0.123=-0.002
σ0.004-0.007=-0.003
min0.115-0.118=-0.003
max0.127-0.140=-0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1015.986-1015.987=-0.001
σ1.165-1.171=-0.006
min1015.410-1015.424=-0.014
max1020.862-1020.886=-0.025
mean1046.250-1050.700=-4.450
σ295.213-313.855=-18.642
min588.000-557.000=31.000
max1461.000-1522.000=-61.000
mean1.545-1.560=-0.015
σ0.046-0.046=0.000
min1.497-1.480=0.017
max1.650-1.654=-0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.056-300.984=0.073
σ0.206-0.257=-0.051
min300.935-300.804=0.131
max301.614-301.674=-0.061
mean2013.000-2014.000=-1.000
σ0.000
min2013.000-2014.000=-1.000
max2013.000-2014.000=-1.000
mean0.598-0.583=0.015
σ0.037-0.027=0.010
min0.538-0.554=-0.016
max0.647-0.620=0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.343-300.341=0.002
σ0.025-0.022=0.002
min300.313-300.314=-0.001
max300.376-300.373=0.003
mean1461.000-1522.000=-61.000
σ0.000
min1461.000-1522.000=-61.000
max1461.000-1522.000=-61.000
mean0.394-0.392=0.001
σ0.008-0.009=-0.001
min0.388-0.385=0.003
max0.403-0.405=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1322.509-1322.510=-0.001
σ0.105-0.104=0.001
min1322.455-1322.456=-0.001
max1322.697-1322.695=0.002
mean1461.000-1522.000=-61.000
σ0.000
min1461.000-1522.000=-61.000
max1461.000-1522.000=-61.000
mean1.899-1.882=0.017
σ0.036-0.028=0.008
min1.852-1.847=0.005
max1.936-1.922=0.015
iters=5
new-facts=6402
prior-facts=1
mean1560.964-1560.959=0.004
σ6.872-6.870=0.003
min1557.665-1557.657=0.008
max1573.251-1573.242=0.009
mean1461.000-1522.000=-61.000
σ0.000
min1461.000-1522.000=-61.000
max1461.000-1522.000=-61.000
mean2.341-2.292=0.049
σ0.198-0.211=-0.013
min2.154-2.140=0.014
max2.678-2.623=0.054
iters=5
new-facts=6402
prior-facts=6402
mean1890.438-1890.442=-0.004
σ0.034-0.031=0.003
min1890.420-1890.415=0.005
max1890.499-1890.495=0.004
mean1739.200-1748.000=-8.800
σ220.788-201.587=19.200
min1461.000-1522.000=-61.000
max2013.000-2014.000=-1.000
mean2.928-2.926=0.002
σ0.032-0.042=-0.010
min2.896-2.885=0.011
max2.973-2.974=-0.001

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.561-1.547=0.014
σ0.152-0.328=-0.176
min1.421-1.159=0.263
max1.752-1.819=-0.067

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.877-442.879=-0.002
σ573.403-573.405=-0.002
min156.171-156.173=-0.001
max1302.981-1302.986=-0.005
mean96.250
σ8.500
min92.000
max109.000
mean1461.000-1522.000=-61.000
σ0.000
min1461.000-1522.000=-61.000
max1461.000-1522.000=-61.000
mean0.552-0.547=0.004
σ0.574-0.568=0.006
min0.260-0.260=-0.000
max1.413-1.400=0.014
policies=20
mean1561.990-1562.009=-0.019
σ0.336-0.342=-0.006
min1561.761-1561.792=-0.032
max1562.489-1562.519=-0.029
mean920.000
σ0.000
min920.000
max920.000
mean1461.000-1522.000=-61.000
σ0.000
min1461.000-1522.000=-61.000
max1461.000-1522.000=-61.000
mean2.616-2.619=-0.002
σ0.017-0.024=-0.007
min2.595-2.593=0.003
max2.634-2.645=-0.011
policies=200
mean15628.006-15627.947=0.059
σ0.122-0.117=0.005
min15627.830-15627.850=-0.019
max15628.105-15628.110=-0.006
mean9200.000
σ0.000
min9200.000
max9200.000
mean1461.000-1522.000=-61.000
σ0.000
min1461.000-1522.000=-61.000
max1461.000-1522.000=-61.000
mean26.460-26.641=-0.181
σ0.110-0.080=0.030
min26.369-26.572=-0.203
max26.620-26.746=-0.126