Compare commits

Home / Compare 2b161c7f .. 9f003922

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.726-36.727=-0.001
σ0.687-0.616=0.072
min35.920-35.924=-0.004
max37.525-37.223=0.301
mean3944.000-3985.000=-41.000
σ0.000
min3944.000-3985.000=-41.000
max3944.000-3985.000=-41.000
mean0.074-0.075=-0.001
σ0.002-0.001=0.001
min0.071-0.074=-0.003
max0.076-0.076=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.711-26.712=-0.001
σ0.645-0.645=0.000
min26.204-26.206=-0.002
max27.466-27.465=0.001
mean3944.000-3985.000=-41.000
σ0.000
min3944.000-3985.000=-41.000
max3944.000-3985.000=-41.000
mean0.058-0.060=-0.002
σ0.002-0.001=0.001
min0.056-0.059=-0.004
max0.061-0.062=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1756.367=0.001
σ0.374-0.372=0.002
min1755.795-1755.796=-0.002
max1756.972-1756.968=0.004
mean1661.800-1657.650=4.150
σ627.647-627.365=0.282
min688.000-683.000=5.000
max2612.000-2607.000=5.000
mean2.286-2.264=0.021
σ0.155-0.143=0.011
min2.117-2.137=-0.019
max2.786-2.776=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.702-278.693=0.009
σ0.006-0.012=-0.006
min278.695-278.686=0.009
max278.710-278.714=-0.005
mean2612.000-2607.000=5.000
σ0.000
min2612.000-2607.000=5.000
max2612.000-2607.000=5.000
mean0.424-0.419=0.005
σ0.009-0.001=0.008
min0.419-0.417=0.002
max0.440-0.420=0.019
iters=5
new-facts=1
prior-facts=6402
mean2268.872-2268.870=0.003
σ0.005-0.006=-0.000
min2268.864-2268.861=0.003
max2268.878-2268.876=0.003
mean2612.000-2607.000=5.000
σ0.000
min2612.000-2607.000=5.000
max2612.000-2607.000=5.000
mean2.982-2.908=0.074
σ0.167-0.086=0.081
min2.856-2.838=0.018
max3.275-3.058=0.217
iters=5
new-facts=6402
prior-facts=1
mean4952.315-4952.299=0.017
σ0.894-0.893=0.001
min4951.837-4951.840=-0.003
max4953.909-4953.895=0.015
mean2612.000-2607.000=5.000
σ0.000
min2612.000-2607.000=5.000
max2612.000-2607.000=5.000
mean8.200-8.249=-0.048
σ0.367-0.326=0.041
min7.741-7.805=-0.064
max8.636-8.667=-0.032
iters=5
new-facts=6402
prior-facts=6402
mean5167.076-5167.067=0.009
σ0.008-0.013=-0.005
min5167.071-5167.052=0.018
max5167.090-5167.088=0.002
mean3396.400-3405.000=-8.600
σ444.408-461.474=-17.066
min2774.000-2769.000=5.000
max3944.000-3985.000=-41.000
mean9.513-9.527=-0.014
σ0.369-0.281=0.088
min9.049-9.074=-0.025
max9.976-9.770=0.206

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.063-1.093=-0.031
σ0.125-0.161=-0.036
min0.946-0.924=0.021
max1.252-1.266=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.256-460.257=-0.001
σ572.609-572.608=0.001
min173.949-173.953=-0.004
max1319.169-1319.169=-0.000
mean79.500
σ7.000
min76.000
max90.000
mean437.000
σ0.000
min437.000
max437.000
mean0.572-0.555=0.017
σ0.589-0.557=0.032
min0.269-0.273=-0.004
max1.456-1.391=0.065
policies=20
mean1740.031-1740.034=-0.003
σ0.333-0.331=0.002
min1739.790-1739.791=-0.001
max1740.519-1740.517=0.002
mean760.000
σ0.000
min760.000
max760.000
mean448.250-447.500=0.750
σ10.308-9.950=0.358
min437.000
max457.000-456.000=1.000
mean2.672-2.667=0.004
σ0.014-0.019=-0.005
min2.657-2.647=0.010
max2.684-2.692=-0.009
policies=200
mean17409.773-17409.745=0.028
σ0.095-0.110=-0.015
min17409.637-17409.582=0.055
max17409.855-17409.812=0.043
mean7600.000
σ0.000
min7600.000
max7600.000
mean493.250-492.500=0.750
σ4.272-1.291=2.981
min488.000-491.000=-3.000
max498.000-494.000=4.000
mean26.960-26.940=0.020
σ0.118-0.200=-0.082
min26.853-26.795=0.057
max27.078-27.226=-0.148