Compare commits

Home / Compare e414a96b .. 382f8c71

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.394-70.392=0.002
σ0.047-0.045=0.002
min70.369-70.370=-0.002
max70.525-70.518=0.007
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.160-0.158=0.002
σ0.005-0.004=0.000
min0.157-0.150=0.006
max0.171-0.163=0.008
cache=y
dps=1
iters=10
policies=100
mean21.149-21.144=0.005
σ0.010-0.003=0.007
min21.143-21.138=0.005
max21.177-21.147=0.030
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.063-0.060=0.003
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.699-1752.698=0.001
σ0.360-0.362=-0.002
min1752.129-1752.128=0.001
max1753.279-1753.284=-0.005
mean1640.400-1652.450=-12.050
σ628.309-641.212=-12.903
min619.000-620.000=-1.000
max2790.000-2768.000=22.000
mean2.878-2.727=0.151
σ0.139-0.197=-0.058
min2.539-2.323=0.216
max3.121-3.106=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.609-270.608=0.001
σ0.009-0.009=-0.000
min270.597-270.595=0.002
max270.621-270.620=0.001
mean2790.000-2768.000=22.000
σ0.000
min2790.000-2768.000=22.000
max2790.000-2768.000=22.000
mean0.385-0.378=0.008
σ0.009-0.004=0.005
min0.378-0.375=0.003
max0.399-0.385=0.014
iters=5
new-facts=1
prior-facts=6402
mean1931.054-1931.044=0.009
σ0.015-0.003=0.012
min1931.029-1931.041=-0.012
max1931.068-1931.048=0.019
mean2790.000-2768.000=22.000
σ0.000
min2790.000-2768.000=22.000
max2790.000-2768.000=22.000
mean2.767-3.077=-0.310
σ0.243-0.195=0.048
min2.477-2.921=-0.445
max3.083-3.399=-0.316
iters=5
new-facts=6402
prior-facts=1
mean4751.529-4751.691=-0.162
σ0.783-0.940=-0.157
min4750.742-4750.811=-0.069
max4752.831-4753.283=-0.452
mean2790.000-2768.000=22.000
σ0.000
min2790.000-2768.000=22.000
max2790.000-2768.000=22.000
mean8.642-8.338=0.304
σ0.522-0.485=0.037
min7.807-7.763=0.044
max9.085-9.027=0.058
iters=5
new-facts=6402
prior-facts=6402
mean4942.237-4942.239=-0.002
σ0.015-0.024=-0.009
min4942.223-4942.202=0.022
max4942.259-4942.266=-0.007
mean3060.800-3073.600=-12.800
σ248.223-294.350=-46.127
min2790.000-2768.000=22.000
max3414.000-3367.000=47.000
mean8.519-8.936=-0.417
σ0.194-0.545=-0.352
min8.337-8.311=0.026
max8.824-9.640=-0.816

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.048=-0.045
σ0.152-0.133=0.018
min0.930-0.928=0.002
max1.273-1.255=0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.216-467.199=0.017
σ575.957-575.920=0.037
min179.227-179.236=-0.009
max1331.151-1331.079=0.072
mean86.250
σ8.500
min82.000
max99.000
mean2790.000-2768.000=22.000
σ0.000
min2790.000-2768.000=22.000
max2790.000-2768.000=22.000
mean0.569-0.442=0.128
σ0.575-0.300=0.275
min0.271-0.291=-0.019
max1.431-0.891=0.540
policies=20
mean1792.606-1792.589=0.018
σ0.371-0.337=0.034
min1792.360-1792.334=0.026
max1793.157-1793.084=0.073
mean820.000
σ0.000
min820.000
max820.000
mean2790.000-2768.000=22.000
σ0.000
min2790.000-2768.000=22.000
max2790.000-2768.000=22.000
mean2.818-2.824=-0.005
σ0.048-0.092=-0.043
min2.789-2.762=0.027
max2.891-2.960=-0.069
policies=200
mean17933.075-17932.969=0.106
σ0.513-0.574=-0.062
min17932.808-17932.547=0.261
max17933.844-17933.810=0.033
mean8200.000
σ0.000
min8200.000
max8200.000
mean2790.000-2768.000=22.000
σ0.000
min2790.000-2768.000=22.000
max2790.000-2768.000=22.000
mean28.096-28.027=0.069
σ0.201-0.122=0.078
min27.972-27.886=0.087
max28.395-28.152=0.243