Compare commits

Home / Compare 6839479d .. 50b0af91

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-35.967=34.599
σ0.045-0.102=-0.057
min70.537-35.922=34.614
max70.690-36.255=34.435
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.159-0.077=0.082
σ0.003-0.003=0.000
min0.154-0.075=0.080
max0.167-0.084=0.082
cache=y
dps=1
iters=10
policies=100
mean21.286-26.209=-4.923
σ0.002-0.002=-0.000
min21.283-26.207=-4.924
max21.291-26.214=-4.924
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.060-0.060=0.000
σ0.003-0.003=-0.000
min0.058-0.057=0.001
max0.067-0.067=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.377-1756.316=-2.939
σ0.361-0.368=-0.007
min1752.803-1755.736=-2.933
max1753.956-1756.906=-2.950
mean1663.300-1656.400=6.900
σ633.864-625.477=8.387
min616.000-613.000=3.000
max2766.000-2700.000=66.000
mean2.801-2.374=0.427
σ0.168-0.140=0.028
min2.265-2.212=0.053
max3.064-2.743=0.322

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.753-278.838=-7.085
σ0.005-0.018=-0.013
min271.747-278.807=-7.060
max271.760-278.849=-7.089
mean2766.000-2700.000=66.000
σ0.000
min2766.000-2700.000=66.000
max2766.000-2700.000=66.000
mean0.378-0.417=-0.039
σ0.002-0.008=-0.005
min0.375-0.410=-0.035
max0.381-0.429=-0.048
iters=5
new-facts=1
prior-facts=6402
mean1932.179-2268.900=-336.721
σ0.011-0.019=-0.008
min1932.165-2268.877=-336.712
max1932.196-2268.921=-336.725
mean2766.000-2700.000=66.000
σ0.000
min2766.000-2700.000=66.000
max2766.000-2700.000=66.000
mean2.982-2.935=0.047
σ0.186-0.045=0.141
min2.764-2.897=-0.133
max3.266-3.012=0.254
iters=5
new-facts=6402
prior-facts=1
mean4752.913-4954.245=-201.332
σ0.849-0.881=-0.032
min4752.414-4953.689=-201.275
max4754.421-4955.809=-201.388
mean2766.000-2700.000=66.000
σ0.000
min2766.000-2700.000=66.000
max2766.000-2700.000=66.000
mean8.441-8.099=0.342
σ0.518-0.459=0.059
min7.610-7.722=-0.112
max8.947-8.694=0.253
iters=5
new-facts=6402
prior-facts=6402
mean4943.381-5168.677=-225.296
σ0.015-0.192=-0.178
min4943.361-5168.413=-225.052
max4943.396-5168.901=-225.505
mean3046.600-3368.200=-321.600
σ242.591-473.088=-230.497
min2766.000-2741.000=25.000
max3395.000-3996.000=-601.000
mean8.807-9.549=-0.742
σ0.254-0.264=-0.010
min8.468-9.117=-0.649
max9.181-9.824=-0.643

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-0.973=0.022
σ0.136-0.055=0.081
min0.931-0.940=-0.008
max1.239-1.069=0.170

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.857-460.358=7.500
σ575.928-572.654=3.274
min179.888-174.028=5.860
max1331.749-1319.338=12.411
mean86.250-79.500=6.750
σ8.500-7.000=1.500
min82.000-76.000=6.000
max99.000-90.000=9.000
mean2766.000-2700.000=66.000
σ0.000
min2766.000-2700.000=66.000
max2766.000-2700.000=66.000
mean0.440-0.546=-0.107
σ0.307-0.538=-0.231
min0.281-0.270=0.011
max0.901-1.354=-0.453
policies=20
mean1799.131-1740.471=58.660
σ0.253-0.311=-0.058
min1798.936-1740.283=58.653
max1799.501-1740.935=58.565
mean820.000-760.000=60.000
σ0.000
min820.000-760.000=60.000
max820.000-760.000=60.000
mean2766.000-2700.000=66.000
σ0.000
min2766.000-2700.000=66.000
max2766.000-2700.000=66.000
mean2.864-2.678=0.187
σ0.082-0.016=0.066
min2.796-2.662=0.134
max2.979-2.701=0.278
policies=200
mean17998.244-17411.880=586.364
σ0.918-0.552=0.366
min17997.061-17411.546=585.515
max17999.301-17412.705=586.596
mean8200.000-7600.000=600.000
σ0.000
min8200.000-7600.000=600.000
max8200.000-7600.000=600.000
mean2766.000-2700.000=66.000
σ0.000
min2766.000-2700.000=66.000
max2766.000-2700.000=66.000
mean28.264-27.061=1.203
σ0.107-0.187=-0.081
min28.175-26.928=1.247
max28.417-27.335=1.082