Compare commits

Home / Compare 699f919c .. edf25c67

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.048-0.050=-0.002
min33.953-33.946=0.007
max34.112-34.118=-0.005
mean415.000-416.600=-1.600
σ0.000-0.516=-0.516
min415.000-416.000=-1.000
max415.000-417.000=-2.000
mean0.084-0.081=0.003
σ0.003-0.004=-0.001
min0.082-0.076=0.006
max0.090-0.088=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.000
σ0.003-0.003=0.000
min23.314-23.313=0.001
max23.323-23.321=0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.066-0.064=0.002
σ0.003-0.004=-0.000
min0.064-0.059=0.005
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.492=0.000
σ0.364-0.364=0.000
min1756.919-1756.919=0.000
max1758.080-1758.080=-0.000
mean1666.300-1664.750=1.550
σ623.379-625.149=-1.770
min689.000-673.000=16.000
max2760.000-2607.000=153.000
mean2.375-2.398=-0.024
σ0.122-0.110=0.012
min2.168-2.290=-0.122
max2.768-2.761=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.632-326.629=0.002
σ0.061-0.060=0.002
min326.523-326.523=-0.000
max326.671-326.661=0.010
mean2760.000-2607.000=153.000
σ0.000
min2760.000-2607.000=153.000
max2760.000-2607.000=153.000
mean0.429-0.427=0.002
σ0.006-0.004=0.002
min0.424-0.425=-0.001
max0.439-0.434=0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.799-1988.796=0.003
σ0.015-0.016=-0.001
min1988.782-1988.778=0.003
max1988.820-1988.812=0.008
mean2760.000-2607.000=153.000
σ0.000
min2760.000-2607.000=153.000
max2760.000-2607.000=153.000
mean2.679-2.722=-0.044
σ0.143-0.103=0.040
min2.576-2.617=-0.042
max2.926-2.885=0.040
iters=5
new-facts=6402
prior-facts=1
mean4813.553-4813.551=0.002
σ7.513-7.768=-0.256
min4810.142-4809.547=0.596
max4826.992-4827.434=-0.443
mean2760.000-2607.000=153.000
σ0.000
min2760.000-2607.000=153.000
max2760.000-2607.000=153.000
mean8.923-8.685=0.238
σ0.444-0.583=-0.139
min8.467-7.711=0.756
max9.539-9.221=0.317
iters=5
new-facts=6402
prior-facts=6402
mean5001.131-5001.201=-0.070
σ0.156-0.027=0.129
min5000.855-5001.171=-0.316
max5001.231-5001.230=0.001
mean2989.200-2949.600=39.600
σ228.327-257.357=-29.030
min2760.000-2607.000=153.000
max3322.000-3290.000=32.000
mean9.645-9.762=-0.117
σ0.182-0.285=-0.103
min9.460-9.353=0.107
max9.901-10.046=-0.146

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.214=-0.211
σ0.141-0.400=-0.259
min0.912-0.920=-0.008
max1.234-1.763=-0.529

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.636-464.629=0.008
σ574.772-574.780=-0.008
min177.240-177.235=0.006
max1326.795-1326.799=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2760.000-2607.000=153.000
σ0.000
min2760.000-2607.000=153.000
max2760.000-2607.000=153.000
mean0.433-0.554=-0.121
σ0.310-0.562=-0.253
min0.278-0.271=0.006
max0.898-1.398=-0.500
policies=20
mean1772.712-1772.645=0.068
σ0.407-0.357=0.050
min1772.443-1772.412=0.031
max1773.317-1773.176=0.141
mean840.000
σ0.000
min840.000
max840.000
mean2760.000-2607.000=153.000
σ0.000
min2760.000-2607.000=153.000
max2760.000-2607.000=153.000
mean2.839-2.732=0.107
σ0.076-0.008=0.068
min2.799-2.724=0.075
max2.953-2.741=0.212
policies=200
mean17733.884-17733.866=0.018
σ0.432-0.552=-0.121
min17733.480-17733.414=0.066
max17734.496-17734.672=-0.176
mean8400.000
σ0.000
min8400.000
max8400.000
mean2760.000-2607.000=153.000
σ0.000
min2760.000-2607.000=153.000
max2760.000-2607.000=153.000
mean27.476-27.486=-0.010
σ0.129-0.140=-0.011
min27.321-27.353=-0.032
max27.616-27.652=-0.036