Compare commits

Home / Compare 3b692394 .. 20cb286b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.000
σ0.047-0.047=0.000
min33.951-33.950=0.001
max34.108-34.107=0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.083-0.084=-0.002
σ0.006-0.003=0.003
min0.076-0.082=-0.006
max0.093-0.090=0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.000
σ0.002-0.003=-0.001
min23.315-23.311=0.004
max23.322-23.323=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.066=-0.000
σ0.002-0.002=0.000
min0.063-0.064=-0.001
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.300-1757.303=-0.003
σ0.364-0.365=-0.002
min1756.728-1756.728=-0.000
max1757.880-1757.889=-0.010
mean1631.500-1659.150=-27.650
σ627.572-620.151=7.421
min652.000-670.000=-18.000
max2840.000-2586.000=254.000
mean2.386-2.344=0.042
σ0.117-0.103=0.014
min2.287-2.187=0.100
max2.653-2.700=-0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.458-326.444=0.014
σ0.022-0.057=-0.035
min326.422-326.342=0.081
max326.483-326.478=0.005
mean2840.000-2586.000=254.000
σ0.000
min2840.000-2586.000=254.000
max2840.000-2586.000=254.000
mean0.425-0.427=-0.002
σ0.004-0.011=-0.007
min0.421-0.421=0.000
max0.431-0.447=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1988.611-1988.614=-0.003
σ0.011-0.010=0.001
min1988.594-1988.599=-0.004
max1988.622-1988.623=-0.001
mean2840.000-2586.000=254.000
σ0.000
min2840.000-2586.000=254.000
max2840.000-2586.000=254.000
mean2.754-2.700=0.054
σ0.141-0.104=0.037
min2.661-2.626=0.035
max2.991-2.879=0.112
iters=5
new-facts=6402
prior-facts=1
mean4813.241-4813.501=-0.260
σ7.885-7.734=0.151
min4808.894-4809.901=-1.007
max4827.320-4827.334=-0.014
mean2840.000-2586.000=254.000
σ0.000
min2840.000-2586.000=254.000
max2840.000-2586.000=254.000
mean8.874-8.581=0.293
σ0.345-0.633=-0.288
min8.443-7.756=0.686
max9.205-9.451=-0.245
iters=5
new-facts=6402
prior-facts=6402
mean5001.018-5000.877=0.142
σ0.038-0.198=-0.160
min5000.979-5000.650=0.328
max5001.063-5001.042=0.021
mean3007.800-2973.800=34.000
σ189.916-280.725=-90.809
min2840.000-2588.000=252.000
max3303.000-3311.000=-8.000
mean9.758-9.626=0.132
σ0.299-0.570=-0.270
min9.415-8.634=0.780
max10.216-10.097=0.119

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.975-1.189=-0.215
σ0.072-0.369=-0.297
min0.917-0.907=0.009
max1.054-1.643=-0.590

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.440-464.437=0.003
σ574.773-574.784=-0.011
min177.044-177.038=0.006
max1326.599-1326.613=-0.014
mean88.250
σ8.500
min84.000
max101.000
mean2840.000-2586.000=254.000
σ0.000
min2840.000-2586.000=254.000
max2840.000-2586.000=254.000
mean0.431-0.537=-0.106
σ0.303-0.525=-0.222
min0.266-0.272=-0.006
max0.885-1.324=-0.440
policies=20
mean1770.775-1770.759=0.016
σ0.364-0.340=0.024
min1770.533-1770.531=0.002
max1771.315-1771.264=0.051
mean840.000
σ0.000
min840.000
max840.000
mean2840.000-2586.000=254.000
σ0.000
min2840.000-2586.000=254.000
max2840.000-2586.000=254.000
mean2.789-2.737=0.052
σ0.004-0.016=-0.012
min2.784-2.717=0.067
max2.793-2.753=0.040
policies=200
mean17714.847-17714.785=0.062
σ0.486-0.614=-0.128
min17714.354-17714.377=-0.023
max17715.518-17715.696=-0.178
mean8400.000
σ0.000
min8400.000
max8400.000
mean2840.000-2586.000=254.000
σ0.000
min2840.000-2586.000=254.000
max2840.000-2586.000=254.000
mean27.744-27.458=0.286
σ0.512-0.055=0.457
min27.107-27.408=-0.301
max28.162-27.534=0.628