Compare commits

Home / Compare ad5e5cd6 .. 225757cd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.123-73.126=-0.003
σ0.055-0.056=-0.002
min73.091-73.093=-0.002
max73.277-73.284=-0.007
mean415.000
σ0.000
min415.000
max415.000
mean0.161-0.163=-0.002
σ0.003-0.004=-0.001
min0.159-0.156=0.003
max0.167-0.170=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.754-23.755=-0.001
σ0.002-0.004=-0.002
min23.750-23.750=0.000
max23.756-23.763=-0.007
mean415.000
σ0.000
min415.000
max415.000
mean0.068-0.066=0.002
σ0.002-0.003=-0.001
min0.066-0.061=0.005
max0.073-0.068=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.822-1755.821=0.001
σ0.358-0.361=-0.004
min1755.250-1755.248=0.002
max1756.390-1756.409=-0.020
mean1649.700-1657.300=-7.600
σ630.229-634.603=-4.374
min634.000-632.000=2.000
max2858.000-2784.000=74.000
mean2.830-2.766=0.064
σ0.086-0.206=-0.120
min2.626-2.257=0.370
max2.955-3.071=-0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.057-321.055=0.002
σ0.039-0.042=-0.003
min320.989-320.981=0.009
max321.082-321.083=-0.001
mean2858.000-2784.000=74.000
σ0.000
min2858.000-2784.000=74.000
max2858.000-2784.000=74.000
mean0.430-0.424=0.006
σ0.015-0.012=0.003
min0.418-0.418=-0.000
max0.448-0.446=0.002
iters=5
new-facts=1
prior-facts=6402
mean1981.618-1981.631=-0.014
σ0.005-0.008=-0.002
min1981.609-1981.622=-0.013
max1981.623-1981.640=-0.017
mean2858.000-2784.000=74.000
σ0.000
min2858.000-2784.000=74.000
max2858.000-2784.000=74.000
mean2.647-2.626=0.020
σ0.085-0.154=-0.069
min2.560-2.442=0.118
max2.771-2.838=-0.067
iters=5
new-facts=6402
prior-facts=1
mean4805.294-4805.172=0.122
σ7.704-7.782=-0.078
min4801.764-4801.230=0.534
max4819.073-4819.083=-0.010
mean2858.000-2784.000=74.000
σ0.000
min2858.000-2784.000=74.000
max2858.000-2784.000=74.000
mean8.537-8.474=0.063
σ0.522-0.409=0.113
min7.631-7.781=-0.149
max8.918-8.781=0.137
iters=5
new-facts=6402
prior-facts=6402
mean4992.828-4992.832=-0.004
σ0.023-0.026=-0.003
min4992.797-4992.800=-0.003
max4992.856-4992.865=-0.008
mean3068.200-3050.600=17.600
σ200.190-239.738=-39.548
min2858.000-2784.000=74.000
max3362.000-3387.000=-25.000
mean8.641-8.621=0.019
σ0.230-0.196=0.034
min8.437-8.422=0.016
max9.001-8.871=0.130

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.002=0.023
σ0.108-0.139=-0.031
min0.919-0.911=0.008
max1.178-1.232=-0.054

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.429-462.425=0.004
σ574.245-574.244=0.001
min175.300-175.291=0.009
max1323.796-1323.790=0.006
mean86.250
σ8.500
min82.000
max99.000
mean2858.000-2784.000=74.000
σ0.000
min2858.000-2784.000=74.000
max2858.000-2784.000=74.000
mean0.431-0.430=0.002
σ0.301-0.299=0.003
min0.277-0.277=0.001
max0.884-0.878=0.006
policies=20
mean1753.252-1753.256=-0.003
σ0.372-0.368=0.004
min1753.011-1753.019=-0.008
max1753.807-1753.804=0.003
mean820.000
σ0.000
min820.000
max820.000
mean2858.000-2784.000=74.000
σ0.000
min2858.000-2784.000=74.000
max2858.000-2784.000=74.000
mean2.776-2.773=0.003
σ0.005-0.004=0.001
min2.769-2.768=0.001
max2.780-2.777=0.003
policies=200
mean17538.949-17537.833=1.117
σ0.399-0.577=-0.178
min17538.582-17537.390=1.192
max17539.320-17538.645=0.675
mean8200.000
σ0.000
min8200.000
max8200.000
mean2858.000-2784.000=74.000
σ0.000
min2858.000-2784.000=74.000
max2858.000-2784.000=74.000
mean27.741-27.370=0.371
σ0.285-0.130=0.156
min27.361-27.196=0.165
max28.045-27.511=0.534