Compare commits

Home / Compare 4f2f4c4d .. a52e4316

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.001
σ0.108-0.107=0.001
min35.752-35.750=0.001
max36.106-36.103=0.003
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.075-0.074=0.001
σ0.003-0.004=-0.001
min0.073-0.069=0.004
max0.082-0.081=0.002
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.000
σ0.003-0.004=-0.001
min26.061-26.061=0.000
max26.070-26.073=-0.003
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.062-0.060=0.001
σ0.003-0.003=-0.000
min0.059-0.056=0.004
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.920-1755.923=-0.003
σ0.365-0.367=-0.002
min1755.353-1755.350=0.003
max1756.515-1756.513=0.002
mean1660.550-1663.200=-2.650
σ623.183-635.935=-12.752
min671.000-672.000=-1.000
max2646.000-2709.000=-63.000
mean2.728-2.759=-0.031
σ0.166-0.166=0.001
min2.304-2.316=-0.012
max2.948-2.934=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.195-277.197=-0.002
σ0.006-0.004=0.002
min277.191-277.192=-0.002
max277.204-277.202=0.003
mean2646.000-2709.000=-63.000
σ0.000
min2646.000-2709.000=-63.000
max2646.000-2709.000=-63.000
mean0.403-0.406=-0.003
σ0.008-0.007=0.001
min0.398-0.402=-0.004
max0.417-0.418=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2174.421-2174.427=-0.006
σ0.018-0.021=-0.003
min2174.400-2174.391=0.009
max2174.445-2174.446=-0.002
mean2646.000-2709.000=-63.000
σ0.000
min2646.000-2709.000=-63.000
max2646.000-2709.000=-63.000
mean2.860-2.981=-0.121
σ0.143-0.175=-0.032
min2.745-2.776=-0.031
max3.073-3.168=-0.095
iters=5
new-facts=6402
prior-facts=1
mean5052.495-5052.271=0.224
σ1.048-1.277=-0.229
min5051.675-5051.037=0.638
max5054.328-5054.377=-0.049
mean2646.000-2709.000=-63.000
σ0.000
min2646.000-2709.000=-63.000
max2646.000-2709.000=-63.000
mean9.130-9.349=-0.219
σ0.390-0.291=0.099
min8.490-8.861=-0.371
max9.420-9.598=-0.178
iters=5
new-facts=6402
prior-facts=6402
mean5188.414-5188.213=0.201
σ0.097-0.382=-0.284
min5188.314-5187.643=0.671
max5188.523-5188.527=-0.004
mean3206.800-3252.000=-45.200
σ477.351-345.453=131.897
min2646.000-2774.000=-128.000
max3851.000-3650.000=201.000
mean8.721-9.022=-0.301
σ0.192-0.414=-0.222
min8.616-8.648=-0.032
max9.063-9.611=-0.548

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.129-1.237=-0.109
σ0.203-0.347=-0.144
min0.942-0.949=-0.007
max1.399-1.828=-0.429

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.860-464.856=0.004
σ572.669-572.656=0.013
min178.522-178.523=-0.001
max1323.864-1323.841=0.023
mean79.500
σ7.000
min76.000
max90.000
mean2646.000-2709.000=-63.000
σ0.000
min2646.000-2709.000=-63.000
max2646.000-2709.000=-63.000
mean0.579-0.560=0.019
σ0.584-0.547=0.037
min0.278-0.277=0.001
max1.455-1.380=0.075
policies=20
mean1785.464-1785.485=-0.020
σ0.343-0.347=-0.003
min1785.241-1785.242=-0.001
max1785.975-1785.997=-0.022
mean760.000
σ0.000
min760.000
max760.000
mean2646.000-2709.000=-63.000
σ0.000
min2646.000-2709.000=-63.000
max2646.000-2709.000=-63.000
mean2.783-2.799=-0.016
σ0.007-0.004=0.002
min2.775-2.793=-0.018
max2.789-2.803=-0.013
policies=200
mean17861.542-17861.557=-0.015
σ0.488-0.522=-0.034
min17861.263-17861.251=0.012
max17862.272-17862.339=-0.067
mean7600.000
σ0.000
min7600.000
max7600.000
mean2646.000-2709.000=-63.000
σ0.000
min2646.000-2709.000=-63.000
max2646.000-2709.000=-63.000
mean28.146-28.169=-0.023
σ0.144-0.157=-0.013
min28.042-28.023=0.019
max28.353-28.340=0.013