Compare commits

Home / Compare 85ac4c41 .. 5a851bfa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.562=0.003
σ0.046-0.044=0.002
min70.540-70.534=0.006
max70.693-70.686=0.007
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.155-0.159=-0.004
σ0.005-0.004=0.000
min0.149-0.150=-0.001
max0.163-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.001
σ0.004-0.002=0.001
min21.281-21.284=-0.003
max21.294-21.290=0.004
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.061=0.003
σ0.003-0.003=-0.000
min0.063-0.058=0.004
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.372-1753.375=-0.003
σ0.360-0.361=-0.001
min1752.809-1752.806=0.003
max1753.939-1753.952=-0.013
mean1649.350-1651.100=-1.750
σ645.063-640.987=4.076
min633.000-634.000=-1.000
max2883.000-2849.000=34.000
mean2.733-2.824=-0.091
σ0.183-0.105=0.077
min2.299-2.610=-0.311
max2.975-2.995=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.758-271.755=0.003
σ0.006-0.009=-0.003
min271.750-271.749=0.001
max271.766-271.770=-0.004
mean2883.000-2849.000=34.000
σ0.000
min2883.000-2849.000=34.000
max2883.000-2849.000=34.000
mean0.386-0.383=0.004
σ0.009-0.005=0.004
min0.379-0.379=0.000
max0.398-0.391=0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.173-1932.175=-0.001
σ0.013-0.009=0.004
min1932.157-1932.165=-0.008
max1932.193-1932.185=0.008
mean2883.000-2849.000=34.000
σ0.000
min2883.000-2849.000=34.000
max2883.000-2849.000=34.000
mean3.035-3.056=-0.021
σ0.119-0.111=0.007
min2.942-2.910=0.031
max3.228-3.167=0.060
iters=5
new-facts=6402
prior-facts=1
mean4752.925-4752.871=0.054
σ0.836-0.909=-0.073
min4752.488-4752.079=0.408
max4754.414-4754.439=-0.025
mean2883.000-2849.000=34.000
σ0.000
min2883.000-2849.000=34.000
max2883.000-2849.000=34.000
mean8.463-7.983=0.480
σ0.346-0.347=-0.002
min7.901-7.699=0.202
max8.781-8.583=0.198
iters=5
new-facts=6402
prior-facts=6402
mean4943.374-4943.308=0.066
σ0.013-0.149=-0.136
min4943.361-4943.044=0.317
max4943.396-4943.402=-0.006
mean3067.600-3056.400=11.200
σ199.159-244.599=-45.440
min2883.000-2849.000=34.000
max3364.000-3427.000=-63.000
mean8.615-8.453=0.162
σ0.251-0.126=0.125
min8.371-8.370=0.000
max8.970-8.672=0.298

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-1.139=-0.116
σ0.123-0.236=-0.113
min0.934-0.935=-0.001
max1.206-1.499=-0.293

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.854-472.856=-0.002
σ575.914-575.923=-0.009
min184.891-184.892=-0.001
max1336.725-1336.740=-0.015
mean88.250
σ8.500
min84.000
max101.000
mean2883.000-2849.000=34.000
σ0.000
min2883.000-2849.000=34.000
max2883.000-2849.000=34.000
mean0.449-0.453=-0.004
σ0.307-0.304=0.003
min0.293-0.300=-0.007
max0.909-0.909=0.001
policies=20
mean1849.207-1849.226=-0.020
σ0.368-0.368=-0.000
min1848.931-1848.948=-0.017
max1849.741-1849.759=-0.019
mean840.000
σ0.000
min840.000
max840.000
mean2883.000-2849.000=34.000
σ0.000
min2883.000-2849.000=34.000
max2883.000-2849.000=34.000
mean2.947-2.956=-0.009
σ0.013-0.038=-0.025
min2.940-2.934=0.006
max2.966-3.013=-0.046
policies=200
mean18498.640-18498.650=-0.010
σ0.405-0.392=0.013
min18498.261-18498.318=-0.057
max18499.204-18499.215=-0.011
mean8400.000
σ0.000
min8400.000
max8400.000
mean2883.000-2849.000=34.000
σ0.000
min2883.000-2849.000=34.000
max2883.000-2849.000=34.000
mean29.278-29.138=0.140
σ0.398-0.441=-0.043
min28.913-28.745=0.167
max29.687-29.753=-0.066