Compare commits

Home / Compare fdd47aa2 .. d39dd3a3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.977=0.002
σ0.049-0.048=0.001
min33.952-33.953=-0.002
max34.114-34.112=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.085-0.080=0.005
σ0.003-0.004=-0.001
min0.082-0.076=0.006
max0.091-0.087=0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.002-0.004=-0.002
min23.314-23.311=0.003
max23.321-23.323=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.064=0.002
σ0.002-0.004=-0.002
min0.064-0.059=0.005
max0.071-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.426=0.003
σ0.364-0.364=-0.000
min1756.855-1756.855=0.001
max1758.016-1758.013=0.003
mean1655.850-1655.650=0.200
σ642.846-643.387=-0.540
min623.000-620.000=3.000
max2737.000-2739.000=-2.000
mean2.374-2.401=-0.027
σ0.085-0.235=-0.151
min2.277-2.191=0.086
max2.567-3.335=-0.767

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.581-326.540=0.041
σ0.027-0.051=-0.024
min326.535-326.448=0.087
max326.606-326.570=0.035
mean2737.000-2739.000=-2.000
σ0.000
min2737.000-2739.000=-2.000
max2737.000-2739.000=-2.000
mean0.421-0.430=-0.008
σ0.001-0.007=-0.006
min0.421-0.421=-0.001
max0.423-0.437=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.740-1988.734=0.005
σ0.014-0.007=0.007
min1988.723-1988.726=-0.003
max1988.754-1988.745=0.009
mean2737.000-2739.000=-2.000
σ0.000
min2737.000-2739.000=-2.000
max2737.000-2739.000=-2.000
mean2.672-2.768=-0.096
σ0.054-0.146=-0.091
min2.614-2.564=0.050
max2.762-2.932=-0.170
iters=5
new-facts=6402
prior-facts=1
mean4813.457-4813.358=0.099
σ7.767-7.847=-0.080
min4809.546-4809.515=0.031
max4827.344-4827.386=-0.043
mean2737.000-2739.000=-2.000
σ0.000
min2737.000-2739.000=-2.000
max2737.000-2739.000=-2.000
mean8.787-8.475=0.313
σ0.293-0.606=-0.313
min8.323-7.727=0.596
max9.072-9.206=-0.135
iters=5
new-facts=6402
prior-facts=6402
mean5001.157-5001.063=0.093
σ0.035-0.165=-0.130
min5001.113-5000.771=0.342
max5001.200-5001.160=0.040
mean3014.800-2983.000=31.800
σ230.554-295.019=-64.465
min2737.000-2739.000=-2.000
max3288.000-3423.000=-135.000
mean9.993-9.592=0.401
σ0.189-0.562=-0.373
min9.674-8.598=1.076
max10.173-9.938=0.235

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.964-1.005=-0.041
σ0.067-0.142=-0.076
min0.905-0.912=-0.006
max1.046-1.239=-0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.565-464.566=-0.001
σ574.771-574.768=0.003
min177.173-177.173=-0.001
max1326.721-1326.718=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2737.000-2739.000=-2.000
σ0.000
min2737.000-2739.000=-2.000
max2737.000-2739.000=-2.000
mean0.551-0.552=-0.001
σ0.556-0.556=-0.000
min0.271-0.272=-0.001
max1.384-1.386=-0.002
policies=20
mean1772.053-1772.015=0.038
σ0.363-0.339=0.024
min1771.821-1771.794=0.027
max1772.594-1772.519=0.075
mean840.000
σ0.000
min840.000
max840.000
mean2737.000-2739.000=-2.000
σ0.000
min2737.000-2739.000=-2.000
max2737.000-2739.000=-2.000
mean2.750-2.712=0.039
σ0.043-0.014=0.029
min2.703-2.696=0.008
max2.796-2.731=0.065
policies=200
mean17727.453-17727.531=-0.078
σ0.610-0.520=0.090
min17727.073-17727.220=-0.148
max17728.363-17728.303=0.060
mean8400.000
σ0.000
min8400.000
max8400.000
mean2737.000-2739.000=-2.000
σ0.000
min2737.000-2739.000=-2.000
max2737.000-2739.000=-2.000
mean27.494-27.606=-0.112
σ0.125-0.062=0.063
min27.347-27.515=-0.167
max27.631-27.648=-0.017