Compare commits

Home / Compare d9b7cb19 .. aac57b09

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.702=-0.001
σ0.046-0.045=0.001
min70.674-70.672=0.002
max70.829-70.827=0.003
mean415.900-411.800=4.100
σ0.316-0.422=-0.105
min415.000-411.000=4.000
max416.000-412.000=4.000
mean0.159-0.160=-0.001
σ0.006-0.005=0.001
min0.150-0.155=-0.004
max0.167-0.173=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=-0.000
σ0.003-0.001=0.002
min21.405-21.406=-0.001
max21.414-21.412=0.003
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.065-0.065=-0.000
σ0.003-0.003=0.001
min0.063-0.064=-0.001
max0.074-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1716.959-1754.898=-37.939
σ169.530-0.362=169.168
min996.709-1754.328=-757.618
max1755.414-1755.496=-0.083
mean1637.150-1645.700=-8.550
σ611.781-633.557=-21.775
min635.000-619.000=16.000
max2461.000-2771.000=-310.000
mean2.727-2.853=-0.126
σ0.358-0.146=0.212
min1.376-2.536=-1.161
max3.026-3.184=-0.158

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.746-272.760=-0.014
σ0.015-0.008=0.007
min272.722-272.751=-0.028
max272.760-272.769=-0.008
mean2461.000-2771.000=-310.000
σ0.000
min2461.000-2771.000=-310.000
max2461.000-2771.000=-310.000
mean0.385-0.385=-0.001
σ0.002-0.007=-0.006
min0.383-0.381=0.002
max0.388-0.399=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1933.124-1933.131=-0.007
σ0.012-0.015=-0.003
min1933.110-1933.112=-0.002
max1933.137-1933.153=-0.016
mean2461.000-2771.000=-310.000
σ0.000
min2461.000-2771.000=-310.000
max2461.000-2771.000=-310.000
mean3.067-3.063=0.004
σ0.170-0.045=0.125
min2.852-3.019=-0.167
max3.312-3.128=0.184
iters=5
new-facts=6402
prior-facts=1
mean4753.883-4753.837=0.045
σ0.934-0.976=-0.042
min4753.393-4753.099=0.294
max4755.549-4755.545=0.005
mean2461.000-2771.000=-310.000
σ0.000
min2461.000-2771.000=-310.000
max2461.000-2771.000=-310.000
mean8.653-8.455=0.199
σ0.542-0.592=-0.051
min7.800-7.745=0.055
max9.108-9.097=0.010
iters=5
new-facts=6402
prior-facts=6402
mean4944.285-4944.361=-0.076
σ0.168-0.022=0.146
min4943.986-4944.336=-0.350
max4944.378-4944.385=-0.007
mean2915.600-3015.800=-100.200
σ393.182-284.334=108.848
min2461.000-2771.000=-310.000
max3465.000-3423.000=42.000
mean8.414-8.451=-0.037
σ0.047-0.093=-0.047
min8.362-8.378=-0.016
max8.470-8.613=-0.142

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.559-1.111=0.449
σ0.071-0.129=-0.058
min1.447-0.995=0.451
max1.634-1.309=0.325

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean469.005-469.028=-0.023
σ575.625-575.628=-0.004
min181.187-181.205=-0.018
max1332.442-1332.470=-0.028
mean88.250
σ8.500
min84.000
max101.000
mean2461.000-2771.000=-310.000
σ0.000
min2461.000-2771.000=-310.000
max2461.000-2771.000=-310.000
mean0.583-0.453=0.129
σ0.586-0.318=0.268
min0.287-0.293=-0.006
max1.462-0.931=0.531
policies=20
mean1812.207-1812.290=-0.084
σ0.393-0.360=0.033
min1811.939-1812.072=-0.132
max1812.785-1812.827=-0.042
mean840.000
σ0.000
min840.000
max840.000
mean2461.000-2771.000=-310.000
σ0.000
min2461.000-2771.000=-310.000
max2461.000-2771.000=-310.000
mean2.871-2.925=-0.054
σ0.029-0.094=-0.064
min2.844-2.832=0.012
max2.911-3.052=-0.140
policies=200
mean18129.174-18129.201=-0.027
σ0.364-0.454=-0.090
min18128.870-18128.930=-0.060
max18129.703-18129.877=-0.174
mean8400.000
σ0.000
min8400.000
max8400.000
mean2461.000-2771.000=-310.000
σ0.000
min2461.000-2771.000=-310.000
max2461.000-2771.000=-310.000
mean28.692-28.595=0.098
σ0.096-0.075=0.021
min28.572-28.511=0.061
max28.804-28.693=0.111