Compare commits

Home / Compare 44aae63b .. 6b4e3e53

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.799=0.001
σ0.107-0.107=0.001
min35.751-35.750=0.001
max36.104-36.101=0.004
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.075-0.074=0.001
σ0.004-0.004=0.000
min0.070-0.069=0.001
max0.082-0.080=0.002
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.000
σ0.004-0.004=-0.001
min26.060-26.059=0.001
max26.071-26.071=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.061-0.060=0.001
σ0.002-0.004=-0.002
min0.060-0.057=0.002
max0.067-0.067=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1755.923=0.001
σ0.365-0.366=-0.001
min1755.351-1755.344=0.007
max1756.513-1756.520=-0.008
mean1666.300-1644.350=21.950
σ629.443-623.792=5.651
min671.000-609.000=62.000
max2663.000-2649.000=14.000
mean2.797-2.817=-0.020
σ0.159-0.177=-0.017
min2.320-2.304=0.016
max2.977-3.049=-0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-277.197=-0.001
σ0.006-0.005=0.001
min277.190-277.192=-0.002
max277.205-277.203=0.002
mean2663.000-2649.000=14.000
σ0.000
min2663.000-2649.000=14.000
max2663.000-2649.000=14.000
mean0.407-0.394=0.013
σ0.008-0.002=0.006
min0.399-0.392=0.006
max0.416-0.397=0.018
iters=5
new-facts=1
prior-facts=6402
mean2174.427-2174.420=0.007
σ0.017-0.031=-0.015
min2174.410-2174.369=0.041
max2174.451-2174.450=0.002
mean2663.000-2649.000=14.000
σ0.000
min2663.000-2649.000=14.000
max2663.000-2649.000=14.000
mean3.126-3.001=0.125
σ0.214-0.126=0.087
min2.836-2.793=0.043
max3.433-3.124=0.308
iters=5
new-facts=6402
prior-facts=1
mean5052.602-5052.479=0.123
σ0.941-1.041=-0.100
min5051.991-5051.719=0.272
max5054.268-5054.311=-0.043
mean2663.000-2649.000=14.000
σ0.000
min2663.000-2649.000=14.000
max2663.000-2649.000=14.000
mean8.833-9.090=-0.256
σ0.591-0.432=0.159
min8.172-8.638=-0.465
max9.372-9.686=-0.314
iters=5
new-facts=6402
prior-facts=6402
mean5188.413-5188.291=0.122
σ0.073-0.202=-0.129
min5188.359-5188.005=0.353
max5188.526-5188.520=0.005
mean3282.600-3222.200=60.400
σ423.635-381.692=41.943
min2684.000-2687.000=-3.000
max3672.000-3699.000=-27.000
mean8.978-8.994=-0.016
σ0.317-0.429=-0.112
min8.700-8.690=0.010
max9.493-9.740=-0.247

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.198=-0.009
σ0.272-0.205=0.067
min0.947-1.053=-0.105
max1.501-1.535=-0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.863-464.850=0.013
σ572.671-572.661=0.010
min178.524-178.516=0.008
max1323.869-1323.841=0.028
mean79.500
σ7.000
min76.000
max90.000
mean2663.000-2649.000=14.000
σ0.000
min2663.000-2649.000=14.000
max2663.000-2649.000=14.000
mean0.552-0.561=-0.010
σ0.528-0.564=-0.036
min0.282-0.271=0.011
max1.344-1.408=-0.063
policies=20
mean1785.485-1785.473=0.012
σ0.348-0.356=-0.007
min1785.262-1785.238=0.023
max1786.003-1786.001=0.003
mean760.000
σ0.000
min760.000
max760.000
mean2663.000-2649.000=14.000
σ0.000
min2663.000-2649.000=14.000
max2663.000-2649.000=14.000
mean2.780-2.790=-0.010
σ0.011-0.010=0.001
min2.766-2.779=-0.013
max2.793-2.800=-0.008
policies=200
mean17861.522-17861.422=0.100
σ0.393-0.440=-0.047
min17861.314-17861.080=0.233
max17862.112-17862.064=0.048
mean7600.000
σ0.000
min7600.000
max7600.000
mean2663.000-2649.000=14.000
σ0.000
min2663.000-2649.000=14.000
max2663.000-2649.000=14.000
mean28.109-28.241=-0.132
σ0.386-0.121=0.265
min27.592-28.145=-0.554
max28.478-28.398=0.080