Compare commits

Home / Compare e468a95b .. 3c6486fd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.396-70.393=0.003
σ0.044-0.045=-0.001
min70.372-70.373=-0.001
max70.518-70.519=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.156-0.161=-0.006
σ0.005-0.003=0.002
min0.149-0.158=-0.009
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.148=-0.004
σ0.002-0.010=-0.008
min21.141-21.141=-0.000
max21.148-21.176=-0.028
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.064-0.067=-0.003
σ0.003-0.002=0.001
min0.060-0.065=-0.006
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.396=-0.000
σ0.361-0.362=-0.002
min1751.823-1751.824=-0.001
max1752.973-1752.974=-0.001
mean1625.650-1655.450=-29.800
σ592.621-644.182=-51.561
min646.000-618.000=28.000
max2414.000-2775.000=-361.000
mean2.824-2.813=0.011
σ0.107-0.141=-0.033
min2.618-2.404=0.214
max3.003-3.121=-0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.239-270.239=-0.000
σ0.008-0.006=0.003
min270.227-270.233=-0.006
max270.247-270.246=0.001
mean2414.000-2775.000=-361.000
σ0.000
min2414.000-2775.000=-361.000
max2414.000-2775.000=-361.000
mean0.380-0.378=0.001
σ0.006-0.006=0.000
min0.371-0.370=0.001
max0.387-0.386=0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.702-1930.704=-0.002
σ0.012-0.008=0.004
min1930.687-1930.694=-0.007
max1930.717-1930.715=0.002
mean2414.000-2775.000=-361.000
σ0.000
min2414.000-2775.000=-361.000
max2414.000-2775.000=-361.000
mean2.565-2.529=0.036
σ0.128-0.093=0.035
min2.463-2.446=0.017
max2.779-2.645=0.134
iters=5
new-facts=6402
prior-facts=1
mean4751.374-4751.285=0.089
σ0.872-0.905=-0.033
min4750.898-4750.494=0.404
max4752.930-4752.847=0.083
mean2414.000-2775.000=-361.000
σ0.000
min2414.000-2775.000=-361.000
max2414.000-2775.000=-361.000
mean8.688-8.501=0.187
σ0.260-0.198=0.062
min8.435-8.191=0.244
max9.059-8.744=0.315
iters=5
new-facts=6402
prior-facts=6402
mean4941.872-4941.792=0.080
σ0.018-0.156=-0.137
min4941.842-4941.518=0.324
max4941.890-4941.888=0.003
mean2975.800-3059.800=-84.000
σ268.029-261.851=6.178
min2624.000-2775.000=-151.000
max3318.000-3424.000=-106.000
mean8.602-8.653=-0.052
σ0.317-0.277=0.040
min8.385-8.348=0.037
max9.163-8.982=0.181

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.794-1.016=0.778
σ0.118-0.141=-0.023
min1.607-0.917=0.691
max1.919-1.241=0.678

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.749-466.753=-0.005
σ575.924-575.932=-0.008
min178.782-178.782=0.000
max1330.634-1330.651=-0.017
mean86.250
σ8.500
min82.000
max99.000
mean2414.000-2775.000=-361.000
σ0.000
min2414.000-2775.000=-361.000
max2414.000-2775.000=-361.000
mean0.563-0.442=0.121
σ0.565-0.303=0.262
min0.279-0.284=-0.006
max1.410-0.897=0.514
policies=20
mean1788.107-1788.151=-0.043
σ0.372-0.352=0.020
min1787.869-1787.904=-0.035
max1788.661-1788.670=-0.008
mean820.000
σ0.000
min820.000
max820.000
mean2414.000-2775.000=-361.000
σ0.000
min2414.000-2775.000=-361.000
max2414.000-2775.000=-361.000
mean2.797-2.855=-0.058
σ0.012-0.053=-0.041
min2.783-2.789=-0.006
max2.811-2.918=-0.108
policies=200
mean17888.092-17888.011=0.081
σ0.373-0.516=-0.143
min17887.845-17887.642=0.203
max17888.643-17888.766=-0.122
mean8200.000
σ0.000
min8200.000
max8200.000
mean2414.000-2775.000=-361.000
σ0.000
min2414.000-2775.000=-361.000
max2414.000-2775.000=-361.000
mean27.985-28.039=-0.054
σ0.149-0.100=0.048
min27.776-27.963=-0.187
max28.124-28.185=-0.062