Compare commits

Home / Compare 449e178a .. 5e51b84a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.050-0.049=0.001
min33.952-33.951=0.001
max34.118-34.114=0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.082-0.085=-0.004
σ0.004-0.004=0.001
min0.076-0.082=-0.006
max0.088-0.091=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.002=0.001
min23.311-23.315=-0.003
max23.322-23.321=0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.062-0.064=-0.002
σ0.004-0.004=-0.000
min0.060-0.060=0.000
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.429=0.001
σ0.365-0.363=0.002
min1756.855-1756.857=-0.002
max1758.021-1758.012=0.009
mean1646.100-1661.300=-15.200
σ625.327-626.836=-1.509
min635.000-667.000=-32.000
max2834.000-2607.000=227.000
mean2.378-2.402=-0.024
σ0.092-0.128=-0.035
min2.261-2.276=-0.014
max2.665-2.795=-0.130

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.577-326.564=0.013
σ0.048-0.058=-0.010
min326.492-326.461=0.031
max326.608-326.601=0.007
mean2834.000-2607.000=227.000
σ0.000
min2834.000-2607.000=227.000
max2834.000-2607.000=227.000
mean0.430-0.427=0.003
σ0.005-0.001=0.004
min0.426-0.426=0.000
max0.437-0.428=0.009
iters=5
new-facts=1
prior-facts=6402
mean1848.406-1988.742=-140.336
σ313.818-0.007=313.811
min1287.030-1988.733=-701.703
max1988.769-1988.752=0.017
mean2834.000-2607.000=227.000
σ0.000
min2834.000-2607.000=227.000
max2834.000-2607.000=227.000
mean2.480-2.683=-0.203
σ0.458-0.097=0.361
min1.708-2.545=-0.837
max2.866-2.802=0.065
iters=5
new-facts=6402
prior-facts=1
mean4813.617-4813.598=0.019
σ7.750-7.708=0.041
min4810.071-4810.039=0.031
max4827.479-4827.386=0.093
mean2834.000-2607.000=227.000
σ0.000
min2834.000-2607.000=227.000
max2834.000-2607.000=227.000
mean8.646-8.401=0.245
σ0.638-0.505=0.133
min7.682-7.864=-0.182
max9.347-9.115=0.232
iters=5
new-facts=6402
prior-facts=6402
mean5001.141-5001.129=0.011
σ0.028-0.034=-0.006
min5001.103-5001.082=0.020
max5001.171-5001.163=0.009
mean2996.200-2946.400=49.800
σ167.727-355.191=-187.464
min2834.000-2607.000=227.000
max3233.000-3416.000=-183.000
mean9.731-9.791=-0.060
σ0.185-0.098=0.087
min9.560-9.676=-0.116
max10.028-9.945=0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.948-1.157=-0.210
σ0.058-0.353=-0.296
min0.910-0.914=-0.004
max1.049-1.769=-0.721

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.573-464.566=0.007
σ574.772-574.783=-0.011
min177.177-177.167=0.010
max1326.730-1326.740=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2834.000-2607.000=227.000
σ0.000
min2834.000-2607.000=227.000
max2834.000-2607.000=227.000
mean0.437-0.556=-0.119
σ0.312-0.558=-0.246
min0.271-0.274=-0.004
max0.906-1.393=-0.487
policies=20
mean1772.078-1772.016=0.062
σ0.363-0.356=0.007
min1771.829-1771.783=0.046
max1772.614-1772.545=0.069
mean840.000
σ0.000
min840.000
max840.000
mean2834.000-2607.000=227.000
σ0.000
min2834.000-2607.000=227.000
max2834.000-2607.000=227.000
mean2.811-2.734=0.077
σ0.009-0.017=-0.008
min2.800-2.716=0.084
max2.821-2.754=0.067
policies=200
mean17727.588-17727.581=0.006
σ0.422-0.565=-0.143
min17727.170-17727.202=-0.032
max17728.165-17728.419=-0.254
mean8400.000
σ0.000
min8400.000
max8400.000
mean2834.000-2607.000=227.000
σ0.000
min2834.000-2607.000=227.000
max2834.000-2607.000=227.000
mean27.996-27.581=0.415
σ0.404-0.132=0.273
min27.568-27.436=0.133
max28.447-27.722=0.725