Compare commits

Home / Compare 7041dab2 .. af647084

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.980=-0.001
σ0.048-0.046=0.001
min33.949-33.950=-0.001
max34.110-34.108=0.002
mean412.000
σ0.000
min412.000
max412.000
mean0.081-0.084=-0.003
σ0.005-0.003=0.002
min0.076-0.080=-0.005
max0.088-0.090=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.316-23.317=-0.001
σ0.002-0.003=-0.001
min23.313-23.313=0.000
max23.322-23.322=0.000
mean412.000
σ0.000
min412.000
max412.000
mean0.064-0.063=0.001
σ0.003-0.002=0.001
min0.061-0.061=0.000
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.494=-0.000
σ0.365-0.364=0.001
min1756.919-1756.920=-0.001
max1758.082-1758.083=-0.001
mean1644.700-1652.250=-7.550
σ625.264-638.842=-13.578
min634.000
max2833.000-2824.000=9.000
mean2.394-2.409=-0.015
σ0.087-0.106=-0.019
min2.284-2.280=0.004
max2.670-2.712=-0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.638-326.642=-0.003
σ0.060-0.061=-0.001
min326.532-326.534=-0.002
max326.681-326.683=-0.002
mean2833.000-2824.000=9.000
σ0.000
min2833.000-2824.000=9.000
max2833.000-2824.000=9.000
mean0.432-0.427=0.005
σ0.010-0.023=-0.013
min0.425-0.389=0.035
max0.449-0.448=0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.803-1988.809=-0.006
σ0.011-0.005=0.006
min1988.790-1988.800=-0.010
max1988.815-1988.815=0.000
mean2833.000-2824.000=9.000
σ0.000
min2833.000-2824.000=9.000
max2833.000-2824.000=9.000
mean2.727-2.687=0.040
σ0.076-0.076=0.001
min2.636-2.628=0.008
max2.841-2.818=0.023
iters=5
new-facts=6402
prior-facts=1
mean4813.702-4813.696=0.006
σ7.753-7.729=0.023
min4810.122-4810.099=0.023
max4827.569-4827.520=0.049
mean2833.000-2824.000=9.000
σ0.000
min2833.000-2824.000=9.000
max2833.000-2824.000=9.000
mean8.761-8.539=0.222
σ0.642-0.602=0.040
min7.727-7.720=0.006
max9.358-9.240=0.118
iters=5
new-facts=6402
prior-facts=6402
mean5001.203-5001.136=0.068
σ0.015-0.170=-0.155
min5001.189-5000.836=0.353
max5001.224-5001.248=-0.024
mean3007.400-3037.200=-29.800
σ237.126-208.617=28.509
min2833.000-2824.000=9.000
max3381.000-3302.000=79.000
mean9.736-9.909=-0.173
σ0.233-0.119=0.114
min9.386-9.779=-0.393
max10.005-10.098=-0.093

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.005=-0.004
σ0.067-0.187=-0.120
min0.917-0.917=0.000
max1.051-1.340=-0.289

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.629-464.625=0.004
σ574.770-574.770=-0.000
min177.236-177.238=-0.002
max1326.784-1326.781=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2833.000-2824.000=9.000
σ0.000
min2833.000-2824.000=9.000
max2833.000-2824.000=9.000
mean0.437-0.438=-0.002
σ0.305-0.312=-0.007
min0.282-0.280=0.002
max0.895-0.907=-0.012
policies=20
mean1772.685-1772.706=-0.020
σ0.369-0.355=0.014
min1772.427-1772.443=-0.016
max1773.229-1773.227=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2833.000-2824.000=9.000
σ0.000
min2833.000-2824.000=9.000
max2833.000-2824.000=9.000
mean2.804-2.813=-0.009
σ0.011-0.011=0.000
min2.788-2.804=-0.016
max2.812-2.828=-0.016
policies=200
mean17734.019-17734.043=-0.025
σ0.516-0.503=0.013
min17733.701-17733.643=0.057
max17734.789-17734.777=0.012
mean8400.000
σ0.000
min8400.000
max8400.000
mean2833.000-2824.000=9.000
σ0.000
min2833.000-2824.000=9.000
max2833.000-2824.000=9.000
mean28.004-28.025=-0.020
σ0.449-0.422=0.027
min27.607-27.556=0.051
max28.495-28.514=-0.020