Compare commits

Home / Compare 47192a8b .. ca70824e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.264=-0.002
σ0.054-0.053=0.001
min35.232-35.239=-0.006
max35.415-35.415=0.001
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.083-0.085=-0.002
σ0.005-0.003=0.001
min0.078-0.082=-0.004
max0.092-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.768-23.770=-0.002
σ0.002-0.002=-0.000
min23.766-23.768=-0.001
max23.772-23.774=-0.003
mean412.000
σ0.000
min412.000
max412.000
mean0.067-0.068=-0.001
σ0.003-0.003=0.000
min0.061-0.066=-0.005
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.471-1756.485=-0.013
σ0.365-0.366=-0.001
min1755.893-1755.912=-0.019
max1757.057-1757.075=-0.019
mean1647.200-1644.850=2.350
σ639.606-642.027=-2.420
min624.000-667.000=-43.000
max2824.000-2724.000=100.000
mean2.331-2.375=-0.045
σ0.089-0.119=-0.030
min2.201-2.192=0.009
max2.566-2.581=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.694-324.699=-0.005
σ0.047-0.056=-0.009
min324.612-324.600=0.011
max324.727-324.737=-0.010
mean2824.000-2724.000=100.000
σ0.000
min2824.000-2724.000=100.000
max2824.000-2724.000=100.000
mean0.429-0.424=0.005
σ0.007-0.002=0.005
min0.422-0.422=0.000
max0.439-0.426=0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.252-1985.266=-0.014
σ0.013-0.014=-0.001
min1985.237-1985.242=-0.005
max1985.265-1985.274=-0.009
mean2824.000-2724.000=100.000
σ0.000
min2824.000-2724.000=100.000
max2824.000-2724.000=100.000
mean2.593-2.610=-0.017
σ0.108-0.084=0.024
min2.452-2.533=-0.081
max2.742-2.727=0.015
iters=5
new-facts=6402
prior-facts=1
mean4808.535-4808.797=-0.262
σ7.903-7.735=0.168
min4804.188-4804.797=-0.609
max4822.637-4822.622=0.015
mean2824.000-2724.000=100.000
σ0.000
min2824.000-2724.000=100.000
max2824.000-2724.000=100.000
mean8.566-8.810=-0.244
σ0.664-0.612=0.051
min7.769-7.743=0.025
max9.134-9.263=-0.129
iters=5
new-facts=6402
prior-facts=6402
mean4996.384-4996.393=-0.009
σ0.165-0.153=0.013
min4996.090-4996.121=-0.031
max4996.471-4996.482=-0.011
mean3040.400-3017.600=22.800
σ291.934-345.238=-53.304
min2824.000-2724.000=100.000
max3498.000-3528.000=-30.000
mean8.505-8.504=0.001
σ0.106-0.119=-0.013
min8.419-8.431=-0.012
max8.685-8.714=-0.029

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.988-0.945=0.043
σ0.153-0.053=0.099
min0.915-0.911=0.003
max1.261-1.038=0.223

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.955-462.963=-0.008
σ574.257-574.281=-0.024
min175.813-175.818=-0.005
max1324.341-1324.384=-0.043
mean86.250
σ8.500
min82.000
max99.000
mean2824.000-2724.000=100.000
σ0.000
min2824.000-2724.000=100.000
max2824.000-2724.000=100.000
mean0.538-0.541=-0.003
σ0.512-0.537=-0.025
min0.278-0.270=0.008
max1.306-1.347=-0.041
policies=20
mean1758.474-1758.530=-0.056
σ0.364-0.343=0.021
min1758.224-1758.298=-0.073
max1759.014-1759.037=-0.024
mean820.000
σ0.000
min820.000
max820.000
mean2824.000-2724.000=100.000
σ0.000
min2824.000-2724.000=100.000
max2824.000-2724.000=100.000
mean2.780-2.712=0.067
σ0.012-0.017=-0.006
min2.771-2.694=0.077
max2.797-2.736=0.061
policies=200
mean17591.114-17592.502=-1.388
σ0.713-0.460=0.254
min17590.142-17592.243=-2.101
max17591.686-17593.191=-1.505
mean8200.000
σ0.000
min8200.000
max8200.000
mean2824.000-2724.000=100.000
σ0.000
min2824.000-2724.000=100.000
max2824.000-2724.000=100.000
mean27.880-27.403=0.477
σ0.268-0.115=0.153
min27.627-27.278=0.349
max28.217-27.526=0.691