Compare commits

Home / Compare e23e876e .. 84ab08b0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.050-0.048=0.003
min33.954-33.950=0.004
max34.120-34.111=0.010
mean414.000
σ0.000
min414.000
max414.000
mean0.085-0.083=0.001
σ0.003-0.004=-0.000
min0.082-0.077=0.005
max0.091-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.002-0.002=-0.001
min23.314-23.315=-0.001
max23.319-23.324=-0.005
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.063=0.002
σ0.003-0.005=-0.002
min0.063-0.059=0.005
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.430=-0.001
σ0.364-0.365=-0.001
min1756.854-1756.855=-0.001
max1758.015-1758.019=-0.004
mean1649.150-1646.950=2.200
σ627.580-625.876=1.704
min636.000
max2823.000-2837.000=-14.000
mean2.325-2.366=-0.042
σ0.082-0.087=-0.005
min2.238-2.264=-0.026
max2.556-2.650=-0.095

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.586-326.571=0.016
σ0.029-0.035=-0.007
min326.537-326.515=0.021
max326.608-326.607=0.000
mean2823.000-2837.000=-14.000
σ0.000
min2823.000-2837.000=-14.000
max2823.000-2837.000=-14.000
mean0.422-0.424=-0.002
σ0.005-0.004=0.001
min0.419-0.421=-0.003
max0.431-0.431=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.741-1988.732=0.009
σ0.006-0.014=-0.007
min1988.735-1988.719=0.016
max1988.751-1988.751=0.000
mean2823.000-2837.000=-14.000
σ0.000
min2823.000-2837.000=-14.000
max2823.000-2837.000=-14.000
mean2.699-2.723=-0.024
σ0.076-0.069=0.006
min2.628-2.646=-0.018
max2.786-2.803=-0.016
iters=5
new-facts=6402
prior-facts=1
mean4813.374-4813.472=-0.098
σ7.562-7.472=0.090
min4809.578-4810.068=-0.490
max4826.894-4826.838=0.056
mean2823.000-2837.000=-14.000
σ0.000
min2823.000-2837.000=-14.000
max2823.000-2837.000=-14.000
mean8.818-8.616=0.202
σ0.390-0.579=-0.189
min8.283-7.809=0.473
max9.210-9.191=0.018
iters=5
new-facts=6402
prior-facts=6402
mean5001.147-5001.074=0.073
σ0.030-0.175=-0.145
min5001.113-5000.763=0.350
max5001.187-5001.174=0.013
mean3036.800-3035.000=1.800
σ199.371-269.659=-70.288
min2823.000-2837.000=-14.000
max3322.000-3451.000=-129.000
mean9.797-9.775=0.022
σ0.253-0.174=0.080
min9.547-9.635=-0.089
max10.217-10.059=0.158

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.940-1.000=-0.060
σ0.060-0.069=-0.009
min0.904-0.912=-0.008
max1.045-1.062=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.562-464.571=-0.009
σ574.767-574.766=0.001
min177.177-177.175=0.002
max1326.712-1326.720=-0.008
mean88.250
σ8.500
min84.000
max101.000
mean2823.000-2837.000=-14.000
σ0.000
min2823.000-2837.000=-14.000
max2823.000-2837.000=-14.000
mean0.434-0.437=-0.003
σ0.304-0.310=-0.006
min0.278-0.280=-0.002
max0.889-0.902=-0.012
policies=20
mean1772.045-1772.088=-0.043
σ0.353-0.366=-0.013
min1771.811-1771.829=-0.018
max1772.569-1772.626=-0.057
mean840.000
σ0.000
min840.000
max840.000
mean2823.000-2837.000=-14.000
σ0.000
min2823.000-2837.000=-14.000
max2823.000-2837.000=-14.000
mean2.776-2.792=-0.017
σ0.007-0.021=-0.014
min2.770-2.773=-0.003
max2.787-2.819=-0.032
policies=200
mean17727.652-17727.667=-0.016
σ0.506-0.455=0.051
min17727.321-17727.341=-0.020
max17728.399-17728.341=0.058
mean8400.000
σ0.000
min8400.000
max8400.000
mean2823.000-2837.000=-14.000
σ0.000
min2823.000-2837.000=-14.000
max2823.000-2837.000=-14.000
mean27.875-27.826=0.049
σ0.441-0.369=0.072
min27.497-27.476=0.021
max28.389-28.169=0.220