Compare commits

Home / Compare 20cb286b .. e4c345f8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.047-0.047=0.000
min33.950-33.951=-0.001
max34.109-34.108=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.081-0.083=-0.001
σ0.004-0.006=-0.002
min0.077-0.076=0.001
max0.090-0.093=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.002-0.002=0.000
min23.314-23.315=-0.001
max23.319-23.322=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.065=-0.001
σ0.002-0.002=-0.000
min0.061-0.063=-0.002
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.301-1757.300=0.001
σ0.364-0.364=0.000
min1756.729-1756.728=0.001
max1757.893-1757.880=0.014
mean1663.400-1631.500=31.900
σ627.574-627.572=0.002
min669.000-652.000=17.000
max2611.000-2840.000=-229.000
mean2.358-2.386=-0.028
σ0.104-0.117=-0.013
min2.236-2.287=-0.052
max2.657-2.653=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.439-326.458=-0.019
σ0.054-0.022=0.032
min326.342-326.422=-0.080
max326.465-326.483=-0.018
mean2611.000-2840.000=-229.000
σ0.000
min2611.000-2840.000=-229.000
max2611.000-2840.000=-229.000
mean0.425-0.425=0.000
σ0.003-0.004=-0.000
min0.419-0.421=-0.002
max0.427-0.431=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1988.618-1988.611=0.007
σ0.004-0.011=-0.007
min1988.615-1988.594=0.020
max1988.625-1988.622=0.004
mean2611.000-2840.000=-229.000
σ0.000
min2611.000-2840.000=-229.000
max2611.000-2840.000=-229.000
mean2.660-2.754=-0.094
σ0.096-0.141=-0.045
min2.515-2.661=-0.146
max2.778-2.991=-0.213
iters=5
new-facts=6402
prior-facts=1
mean4813.455-4813.241=0.214
σ7.717-7.885=-0.168
min4809.916-4808.894=1.023
max4827.258-4827.320=-0.061
mean2611.000-2840.000=-229.000
σ0.000
min2611.000-2840.000=-229.000
max2611.000-2840.000=-229.000
mean8.817-8.874=-0.057
σ0.363-0.345=0.018
min8.394-8.443=-0.049
max9.205-9.205=-0.001
iters=5
new-facts=6402
prior-facts=6402
mean5000.939-5001.018=-0.080
σ0.170-0.038=0.132
min5000.635-5000.979=-0.344
max5001.024-5001.063=-0.039
mean2967.000-3007.800=-40.800
σ266.278-189.916=76.362
min2611.000-2840.000=-229.000
max3299.000-3303.000=-4.000
mean9.525-9.758=-0.233
σ0.431-0.299=0.132
min8.784-9.415=-0.630
max9.870-10.216=-0.346

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.225-0.975=0.250
σ0.374-0.072=0.302
min0.909-0.917=-0.008
max1.767-1.054=0.713

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.436-464.440=-0.004
σ574.794-574.773=0.021
min177.037-177.044=-0.007
max1326.627-1326.599=0.028
mean88.250
σ8.500
min84.000
max101.000
mean2611.000-2840.000=-229.000
σ0.000
min2611.000-2840.000=-229.000
max2611.000-2840.000=-229.000
mean0.568-0.431=0.137
σ0.591-0.303=0.288
min0.271-0.266=0.005
max1.454-0.885=0.569
policies=20
mean1770.737-1770.775=-0.038
σ0.367-0.364=0.003
min1770.493-1770.533=-0.040
max1771.282-1771.315=-0.033
mean840.000
σ0.000
min840.000
max840.000
mean2611.000-2840.000=-229.000
σ0.000
min2611.000-2840.000=-229.000
max2611.000-2840.000=-229.000
mean2.737-2.789=-0.052
σ0.037-0.004=0.033
min2.706-2.784=-0.078
max2.782-2.793=-0.011
policies=200
mean17714.794-17714.847=-0.052
σ0.445-0.486=-0.042
min17714.456-17714.354=0.103
max17715.441-17715.518=-0.077
mean8400.000
σ0.000
min8400.000
max8400.000
mean2611.000-2840.000=-229.000
σ0.000
min2611.000-2840.000=-229.000
max2611.000-2840.000=-229.000
mean27.523-27.744=-0.221
σ0.268-0.512=-0.244
min27.273-27.107=0.165
max27.894-28.162=-0.268