Compare commits

Home / Compare b47516ac .. f7fff7d2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.245=0.019
σ0.052-0.053=-0.001
min35.237-35.221=0.017
max35.411-35.395=0.017
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.085-0.084=0.001
σ0.003-0.005=-0.002
min0.083-0.076=0.006
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.004-0.004=0.000
min23.765-23.764=0.001
max23.781-23.779=0.002
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.067-0.067=0.000
σ0.002-0.005=-0.002
min0.065-0.061=0.004
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.485=0.000
σ0.364-0.365=-0.002
min1755.910-1755.910=-0.000
max1757.072-1757.077=-0.005
mean1655.450-1657.950=-2.500
σ642.588-642.352=0.236
min628.000-631.000=-3.000
max2797.000-2841.000=-44.000
mean2.360-2.370=-0.009
σ0.107-0.061=0.046
min2.238-2.288=-0.049
max2.654-2.478=0.177

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.688-324.700=-0.012
σ0.052-0.055=-0.004
min324.598-324.601=-0.004
max324.729-324.730=-0.001
mean2797.000-2841.000=-44.000
σ0.000
min2797.000-2841.000=-44.000
max2797.000-2841.000=-44.000
mean0.432-0.430=0.003
σ0.009-0.009=0.001
min0.424-0.421=0.003
max0.445-0.440=0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.263-1985.258=0.005
σ0.019-0.017=0.002
min1985.232-1985.234=-0.003
max1985.279-1985.273=0.006
mean2797.000-2841.000=-44.000
σ0.000
min2797.000-2841.000=-44.000
max2797.000-2841.000=-44.000
mean2.743-2.658=0.085
σ0.268-0.124=0.145
min2.544-2.518=0.026
max3.158-2.828=0.330
iters=5
new-facts=6402
prior-facts=1
mean4808.686-4808.866=-0.180
σ7.828-7.724=0.104
min4804.791-4805.332=-0.541
max4822.672-4822.683=-0.011
mean2797.000-2841.000=-44.000
σ0.000
min2797.000-2841.000=-44.000
max2797.000-2841.000=-44.000
mean8.727-8.887=-0.160
σ0.663-0.328=0.335
min7.591-8.535=-0.943
max9.209-9.340=-0.130
iters=5
new-facts=6402
prior-facts=6402
mean4996.396-4996.459=-0.062
σ0.147-0.014=0.133
min4996.135-4996.445=-0.310
max4996.486-4996.475=0.011
mean3019.800-3064.000=-44.200
σ225.405-295.556=-70.152
min2797.000-2841.000=-44.000
max3327.000-3518.000=-191.000
mean8.699-8.501=0.198
σ0.259-0.094=0.165
min8.469-8.429=0.040
max9.073-8.665=0.408

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.945-0.971=-0.026
σ0.059-0.072=-0.014
min0.909-0.907=0.003
max1.047-1.057=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.975-462.973=0.002
σ574.254-574.256=-0.001
min175.837-175.839=-0.001
max1324.356-1324.356=-0.000
mean86.250
σ8.500
min82.000
max99.000
mean2797.000-2841.000=-44.000
σ0.000
min2797.000-2841.000=-44.000
max2797.000-2841.000=-44.000
mean0.470-0.432=0.038
σ0.367-0.300=0.067
min0.285-0.276=0.008
max1.020-0.881=0.139
policies=20
mean1758.677-1758.722=-0.045
σ0.312-0.354=-0.042
min1758.462-1758.479=-0.017
max1759.139-1759.246=-0.107
mean820.000
σ0.000
min820.000
max820.000
mean2797.000-2841.000=-44.000
σ0.000
min2797.000-2841.000=-44.000
max2797.000-2841.000=-44.000
mean2.818-2.806=0.012
σ0.077-0.039=0.038
min2.767-2.764=0.003
max2.933-2.850=0.082
policies=200
mean17592.397-17593.094=-0.697
σ0.558-0.653=-0.095
min17591.932-17592.201=-0.269
max17593.209-17593.597=-0.388
mean8200.000
σ0.000
min8200.000
max8200.000
mean2797.000-2841.000=-44.000
σ0.000
min2797.000-2841.000=-44.000
max2797.000-2841.000=-44.000
mean27.414-27.963=-0.549
σ0.126-0.258=-0.132
min27.231-27.737=-0.505
max27.512-28.312=-0.801