Compare commits

Home / Compare 5647fc2b .. d6e28b07

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.780=0.000
σ0.050-0.052=-0.002
min70.746-70.749=-0.003
max70.921-70.927=-0.006
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.159-0.158=0.000
σ0.005-0.004=0.000
min0.152-0.152=0.000
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.495-21.494=0.001
σ0.003-0.002=0.000
min21.491-21.490=0.001
max21.500-21.498=0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.066-0.064=0.002
σ0.002-0.004=-0.002
min0.064-0.059=0.005
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.881-1751.880=0.001
σ0.360-0.361=-0.001
min1751.313-1751.310=0.003
max1752.464-1752.467=-0.002
mean1640.200-1665.400=-25.200
σ627.978-627.395=0.583
min621.000-684.000=-63.000
max2775.000-2757.000=18.000
mean2.884-2.815=0.069
σ0.198-0.138=0.060
min2.320-2.435=-0.115
max3.138-2.991=0.147

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.378-269.377=0.001
σ0.006-0.004=0.001
min269.373-269.373=-0.000
max269.387-269.382=0.005
mean2775.000-2757.000=18.000
σ0.000
min2775.000-2757.000=18.000
max2775.000-2757.000=18.000
mean0.377-0.376=0.001
σ0.005-0.005=0.001
min0.374-0.371=0.002
max0.387-0.384=0.003
iters=5
new-facts=1
prior-facts=6402
mean1929.741-1929.752=-0.011
σ0.018-0.004=0.014
min1929.723-1929.747=-0.024
max1929.764-1929.755=0.009
mean2775.000-2757.000=18.000
σ0.000
min2775.000-2757.000=18.000
max2775.000-2757.000=18.000
mean2.996-3.083=-0.087
σ0.105-0.104=0.001
min2.835-2.989=-0.155
max3.127-3.197=-0.070
iters=5
new-facts=6402
prior-facts=1
mean4750.503-4750.378=0.125
σ0.845-0.931=-0.086
min4750.046-4749.631=0.414
max4752.009-4752.005=0.004
mean2775.000-2757.000=18.000
σ0.000
min2775.000-2757.000=18.000
max2775.000-2757.000=18.000
mean8.451-8.476=-0.025
σ0.439-0.459=-0.020
min7.834-7.809=0.026
max8.898-8.925=-0.027
iters=5
new-facts=6402
prior-facts=6402
mean4940.853-4940.987=-0.134
σ0.181-0.015=0.166
min4940.633-4940.968=-0.335
max4940.997-4941.000=-0.003
mean2968.000-3042.800=-74.800
σ256.031-239.603=16.428
min2775.000-2757.000=18.000
max3375.000-3331.000=44.000
mean8.395-8.511=-0.116
σ0.045-0.123=-0.077
min8.347-8.373=-0.026
max8.463-8.683=-0.221

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-0.993=0.034
σ0.139-0.142=-0.003
min0.933-0.923=0.010
max1.254-1.247=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.719-462.699=0.019
σ574.967-574.941=0.026
min175.225-175.223=0.002
max1325.170-1325.111=0.059
mean86.250
σ8.500
min82.000
max99.000
mean2775.000-2757.000=18.000
σ0.000
min2775.000-2757.000=18.000
max2775.000-2757.000=18.000
mean0.585-0.562=0.024
σ0.623-0.568=0.055
min0.272-0.275=-0.003
max1.520-1.414=0.105
policies=20
mean1752.497-1752.491=0.006
σ0.360-0.354=0.006
min1752.283-1752.265=0.018
max1753.035-1753.020=0.016
mean820.000
σ0.000
min820.000
max820.000
mean2775.000-2757.000=18.000
σ0.000
min2775.000-2757.000=18.000
max2775.000-2757.000=18.000
mean2.737-2.730=0.007
σ0.026-0.015=0.011
min2.710-2.715=-0.005
max2.772-2.748=0.024
policies=200
mean17532.348-17532.226=0.122
σ0.503-0.528=-0.025
min17532.088-17531.864=0.224
max17533.102-17533.002=0.100
mean8200.000
σ0.000
min8200.000
max8200.000
mean2775.000-2757.000=18.000
σ0.000
min2775.000-2757.000=18.000
max2775.000-2757.000=18.000
mean27.641-27.581=0.060
σ0.136-0.043=0.093
min27.541-27.535=0.006
max27.835-27.637=0.198