Compare commits

Home / Compare 4c38b8ad .. 5889279c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.051-0.050=0.001
min33.951-33.951=-0.000
max34.120-34.115=0.005
mean412.000
σ0.000
min412.000
max412.000
mean0.084-0.082=0.002
σ0.003-0.006=-0.004
min0.082-0.077=0.005
max0.090-0.095=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.316-23.317=-0.000
σ0.002-0.002=-0.000
min23.313-23.313=-0.000
max23.319-23.321=-0.002
mean412.000
σ0.000
min412.000
max412.000
mean0.065-0.065=0.000
σ0.002-0.003=-0.001
min0.064-0.064=0.000
max0.071-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.304=-0.001
σ0.365-0.365=0.001
min1756.729-1756.728=0.001
max1757.889-1757.896=-0.006
mean1658.950-1658.350=0.600
σ644.327-620.616=23.711
min627.000-668.000=-41.000
max2825.000-2587.000=238.000
mean2.353-2.354=-0.000
σ0.073-0.094=-0.022
min2.260-2.179=0.081
max2.483-2.600=-0.117

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.429-326.445=-0.016
σ0.034-0.047=-0.014
min326.372-326.363=0.009
max326.460-326.484=-0.024
mean2825.000-2587.000=238.000
σ0.000
min2825.000-2587.000=238.000
max2825.000-2587.000=238.000
mean0.429-0.423=0.005
σ0.006-0.001=0.005
min0.424-0.422=0.002
max0.435-0.424=0.011
iters=5
new-facts=1
prior-facts=6402
mean1988.604-1988.617=-0.013
σ0.016-0.005=0.011
min1988.580-1988.610=-0.030
max1988.618-1988.624=-0.006
mean2825.000-2587.000=238.000
σ0.000
min2825.000-2587.000=238.000
max2825.000-2587.000=238.000
mean2.739-2.736=0.003
σ0.154-0.154=-0.001
min2.616-2.561=0.055
max3.007-2.960=0.048
iters=5
new-facts=6402
prior-facts=1
mean4813.457-4813.346=0.110
σ7.744-7.792=-0.048
min4809.947-4809.398=0.549
max4827.310-4827.276=0.033
mean2825.000-2587.000=238.000
σ0.000
min2825.000-2587.000=238.000
max2825.000-2587.000=238.000
mean8.742-8.972=-0.231
σ0.524-0.243=0.282
min7.990-8.716=-0.725
max9.296-9.239=0.057
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-5001.010=0.000
σ0.027-0.022=0.006
min5000.985-5000.986=-0.001
max5001.052-5001.041=0.010
mean3029.800-2999.800=30.000
σ210.697-312.059=-101.362
min2825.000-2587.000=238.000
max3325.000-3405.000=-80.000
mean9.812-9.416=0.396
σ0.229-0.542=-0.312
min9.422-8.517=0.905
max10.005-9.975=0.030

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.949-1.179=-0.230
σ0.055-0.326=-0.271
min0.914-0.925=-0.011
max1.045-1.725=-0.681

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.432-464.439=-0.006
σ574.769-574.785=-0.016
min177.042-177.039=0.003
max1326.585-1326.616=-0.030
mean88.250
σ8.500
min84.000
max101.000
mean2825.000-2587.000=238.000
σ0.000
min2825.000-2587.000=238.000
max2825.000-2587.000=238.000
mean0.436-0.544=-0.109
σ0.302-0.538=-0.236
min0.282-0.273=0.008
max0.889-1.352=-0.462
policies=20
mean1770.762-1770.765=-0.003
σ0.350-0.357=-0.007
min1770.547-1770.531=0.016
max1771.284-1771.296=-0.012
mean840.000
σ0.000
min840.000
max840.000
mean2825.000-2587.000=238.000
σ0.000
min2825.000-2587.000=238.000
max2825.000-2587.000=238.000
mean2.790-2.727=0.063
σ0.011-0.028=-0.016
min2.775-2.705=0.069
max2.802-2.767=0.035
policies=200
mean17714.859-17714.940=-0.081
σ0.530-0.388=0.142
min17714.549-17714.727=-0.178
max17715.651-17715.521=0.130
mean8400.000
σ0.000
min8400.000
max8400.000
mean2825.000-2587.000=238.000
σ0.000
min2825.000-2587.000=238.000
max2825.000-2587.000=238.000
mean27.816-27.483=0.333
σ0.390-0.133=0.258
min27.353-27.340=0.012
max28.161-27.611=0.550