Compare commits

Home / Compare b9f12728 .. 39e2586c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.988-33.985=0.003
σ0.054-0.054=-0.000
min33.959-33.955=0.004
max34.140-34.138=0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.085-0.082=0.003
σ0.004-0.005=-0.001
min0.082-0.076=0.005
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.324-23.324=0.000
σ0.002-0.002=0.000
min23.321-23.321=-0.000
max23.327-23.327=-0.000
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.065-0.065=-0.000
σ0.003-0.003=0.000
min0.061-0.063=-0.002
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.726-1756.727=-0.001
σ0.364-0.365=-0.001
min1756.162-1756.152=0.010
max1757.306-1757.318=-0.012
mean1642.600-1645.850=-3.250
σ623.316-635.305=-11.989
min625.000-626.000=-1.000
max2691.000-2835.000=-144.000
mean2.411-2.330=0.081
σ0.174-0.080=0.094
min2.270-2.236=0.034
max2.949-2.568=0.381

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.322-325.313=0.010
σ0.039-0.055=-0.016
min325.253-325.215=0.039
max325.349-325.345=0.004
mean2691.000-2835.000=-144.000
σ0.000
min2691.000-2835.000=-144.000
max2691.000-2835.000=-144.000
mean0.428-0.426=0.002
σ0.004-0.003=0.001
min0.425-0.424=0.001
max0.433-0.431=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.846-1985.880=-0.034
σ0.071-0.012=0.059
min1985.721-1985.863=-0.143
max1985.891-1985.894=-0.004
mean2691.000-2835.000=-144.000
σ0.000
min2691.000-2835.000=-144.000
max2691.000-2835.000=-144.000
mean2.737-2.665=0.072
σ0.146-0.049=0.097
min2.560-2.611=-0.051
max2.944-2.741=0.203
iters=5
new-facts=6402
prior-facts=1
mean4809.638-4809.409=0.228
σ7.672-7.491=0.181
min4806.177-4805.745=0.432
max4823.361-4822.806=0.556
mean2691.000-2835.000=-144.000
σ0.000
min2691.000-2835.000=-144.000
max2691.000-2835.000=-144.000
mean8.736-8.686=0.049
σ0.187-0.354=-0.167
min8.465-8.147=0.319
max8.975-9.049=-0.074
iters=5
new-facts=6402
prior-facts=6402
mean4817.030-4997.182=-180.152
σ402.875-0.021=402.854
min4096.345-4997.159=-900.814
max4997.224-4997.210=0.014
mean2978.600-3059.000=-80.400
σ240.904-238.566=2.339
min2691.000-2835.000=-144.000
max3317.000-3409.000=-92.000
mean8.794-8.730=0.064
σ0.964-0.084=0.880
min7.287-8.582=-1.294
max9.637-8.786=0.852

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-1.040=0.046
σ0.080-0.132=-0.052
min1.040-0.924=0.116
max1.227-1.248=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.374-463.382=-0.008
σ574.779-574.771=0.008
min175.983-175.982=0.001
max1325.543-1325.539=0.004
mean86.250
σ8.500
min82.000
max99.000
mean2691.000-2835.000=-144.000
σ0.000
min2691.000-2835.000=-144.000
max2691.000-2835.000=-144.000
mean0.546-0.475=0.071
σ0.546-0.387=0.159
min0.269-0.280=-0.011
max1.365-1.055=0.310
policies=20
mean1760.130-1760.154=-0.024
σ0.339-0.352=-0.013
min1759.904-1759.911=-0.007
max1760.633-1760.674=-0.041
mean820.000
σ0.000
min820.000
max820.000
mean2691.000-2835.000=-144.000
σ0.000
min2691.000-2835.000=-144.000
max2691.000-2835.000=-144.000
mean2.726-2.786=-0.059
σ0.016-0.006=0.009
min2.710-2.780=-0.070
max2.747-2.791=-0.044
policies=200
mean17608.300-17608.389=-0.089
σ0.442-0.449=-0.007
min17608.017-17607.918=0.099
max17608.958-17608.993=-0.035
mean8200.000
σ0.000
min8200.000
max8200.000
mean2691.000-2835.000=-144.000
σ0.000
min2691.000-2835.000=-144.000
max2691.000-2835.000=-144.000
mean27.453-27.821=-0.367
σ0.084-0.470=-0.387
min27.365-27.354=0.011
max27.550-28.407=-0.857