Compare commits

Home / Compare e42ed8b5 .. 27f253cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.984=-0.006
σ0.050-0.049=0.001
min33.942-33.952=-0.010
max34.118-34.121=-0.003
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.085-0.081=0.004
σ0.005-0.004=0.001
min0.081-0.076=0.005
max0.094-0.088=0.007
cache=y
dps=1
iters=10
policies=100
mean23.318-23.323=-0.005
σ0.004-0.003=0.001
min23.311-23.320=-0.009
max23.324-23.328=-0.005
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.065-0.064=0.001
σ0.002-0.004=-0.002
min0.063-0.059=0.004
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.297=0.006
σ0.365-0.364=0.002
min1756.728-1756.725=0.004
max1757.889-1757.887=0.002
mean1669.800-1635.750=34.050
σ614.872-621.912=-7.041
min670.000-619.000=51.000
max2590.000-2682.000=-92.000
mean2.384-2.408=-0.024
σ0.173-0.173=0.000
min2.270-2.255=0.014
max3.084-2.952=0.132

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.445-326.419=0.026
σ0.044-0.056=-0.011
min326.368-326.321=0.047
max326.481-326.460=0.021
mean2590.000-2682.000=-92.000
σ0.000
min2590.000-2682.000=-92.000
max2590.000-2682.000=-92.000
mean0.425-0.433=-0.008
σ0.005-0.006=-0.001
min0.421-0.425=-0.004
max0.433-0.439=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.605-1988.604=0.001
σ0.017-0.008=0.010
min1988.584-1988.594=-0.010
max1988.625-1988.612=0.013
mean2590.000-2682.000=-92.000
σ0.000
min2590.000-2682.000=-92.000
max2590.000-2682.000=-92.000
mean2.758-2.750=0.008
σ0.166-0.110=0.055
min2.523-2.667=-0.144
max2.920-2.936=-0.016
iters=5
new-facts=6402
prior-facts=1
mean4813.452-4812.246=1.205
σ7.732-7.474=0.257
min4809.912-4808.860=1.052
max4827.282-4825.617=1.665
mean2590.000-2682.000=-92.000
σ0.000
min2590.000-2682.000=-92.000
max2590.000-2682.000=-92.000
mean8.550-8.637=-0.086
σ0.520-0.461=0.060
min7.779-7.920=-0.141
max9.241-9.164=0.077
iters=5
new-facts=6402
prior-facts=6402
mean5001.018-4999.930=1.088
σ0.033-0.019=0.014
min5000.983-4999.910=1.073
max5001.055-4999.952=1.103
mean2981.600-2947.000=34.600
σ363.102-312.201=50.901
min2590.000-2682.000=-92.000
max3487.000-3407.000=80.000
mean9.927-9.599=0.329
σ0.137-0.622=-0.486
min9.796-8.499=1.297
max10.078-10.034=0.044

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.166-1.075=0.091
σ0.328-0.157=0.171
min0.914-0.916=-0.002
max1.708-1.237=0.472

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.437-464.428=0.009
σ574.779-574.779=-0.000
min177.042-177.033=0.009
max1326.606-1326.597=0.009
mean88.250
σ8.500
min84.000
max101.000
mean2590.000-2682.000=-92.000
σ0.000
min2590.000-2682.000=-92.000
max2590.000-2682.000=-92.000
mean0.568-0.543=0.025
σ0.594-0.534=0.060
min0.269-0.273=-0.004
max1.459-1.344=0.115
policies=20
mean1770.757-1770.656=0.101
σ0.346-0.354=-0.009
min1770.524-1770.423=0.101
max1771.270-1771.184=0.086
mean840.000
σ0.000
min840.000
max840.000
mean2590.000-2682.000=-92.000
σ0.000
min2590.000-2682.000=-92.000
max2590.000-2682.000=-92.000
mean2.702-2.731=-0.028
σ0.016-0.016=0.000
min2.689-2.720=-0.031
max2.720-2.754=-0.034
policies=200
mean17714.797-17713.815=0.982
σ0.595-0.470=0.126
min17714.425-17713.551=0.874
max17715.686-17714.519=1.167
mean8400.000
σ0.000
min8400.000
max8400.000
mean2590.000-2682.000=-92.000
σ0.000
min2590.000-2682.000=-92.000
max2590.000-2682.000=-92.000
mean27.470-27.562=-0.092
σ0.085-0.092=-0.007
min27.352-27.481=-0.129
max27.555-27.691=-0.136