Compare commits

Home / Compare c1ea6921 .. daf66e42

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.395-70.390=0.005
σ0.047-0.047=0.000
min70.364-70.365=-0.001
max70.523-70.522=0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.159-0.161=-0.002
σ0.004-0.003=0.001
min0.155-0.158=-0.004
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.002-0.001=0.001
min21.143-21.142=0.001
max21.148-21.146=0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.064-0.064=0.000
σ0.002-0.003=-0.000
min0.063-0.062=0.001
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.698-1752.393=0.305
σ0.363-0.359=0.004
min1752.122-1751.823=0.298
max1753.284-1752.956=0.327
mean1647.050-1630.450=16.600
σ632.750-589.866=42.884
min619.000-628.000=-9.000
max2769.000-2418.000=351.000
mean2.812-2.780=0.032
σ0.128-0.209=-0.082
min2.569-2.279=0.289
max3.123-3.016=0.107

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.611-270.140=0.470
σ0.006-0.006=0.000
min270.601-270.132=0.469
max270.618-270.148=0.470
mean2769.000-2418.000=351.000
σ0.000
min2769.000-2418.000=351.000
max2769.000-2418.000=351.000
mean0.379-0.378=0.002
σ0.004-0.005=-0.001
min0.377-0.370=0.007
max0.386-0.384=0.002
iters=5
new-facts=1
prior-facts=6402
mean1931.042-1930.605=0.437
σ0.009-0.008=0.000
min1931.035-1930.596=0.439
max1931.057-1930.618=0.439
mean2769.000-2418.000=351.000
σ0.000
min2769.000-2418.000=351.000
max2769.000-2418.000=351.000
mean2.989-2.509=0.481
σ0.041-0.056=-0.015
min2.948-2.454=0.494
max3.052-2.578=0.474
iters=5
new-facts=6402
prior-facts=1
mean4751.804-4751.236=0.568
σ0.836-0.968=-0.131
min4751.221-4750.510=0.710
max4753.276-4752.929=0.347
mean2769.000-2418.000=351.000
σ0.000
min2769.000-2418.000=351.000
max2769.000-2418.000=351.000
mean8.203-8.379=-0.176
σ0.629-0.538=0.091
min7.732-7.666=0.066
max9.172-9.042=0.130
iters=5
new-facts=6402
prior-facts=6402
mean4942.162-4941.702=0.460
σ0.147-0.143=0.003
min4941.903-4941.446=0.458
max4942.258-4941.776=0.482
mean3037.400-2984.800=52.600
σ326.486-284.178=42.307
min2769.000-2602.000=167.000
max3527.000-3324.000=203.000
mean8.459-8.501=-0.043
σ0.134-0.218=-0.084
min8.355-8.200=0.155
max8.693-8.740=-0.048

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.107-1.839=-0.733
σ0.255-0.073=0.182
min0.928-1.750=-0.822
max1.547-1.949=-0.403

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.205-466.367=0.837
σ575.929-575.931=-0.001
min179.234-178.399=0.835
max1331.098-1330.263=0.835
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2769.000-2418.000=351.000
σ0.000
min2769.000-2418.000=351.000
max2769.000-2418.000=351.000
mean0.477-0.568=-0.091
σ0.386-0.573=-0.187
min0.283-0.279=0.004
max1.056-1.427=-0.371
policies=20
mean1792.615-1784.309=8.306
σ0.359-0.352=0.007
min1792.394-1784.084=8.311
max1793.151-1784.833=8.318
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2769.000-2418.000=351.000
σ0.000
min2769.000-2418.000=351.000
max2769.000-2418.000=351.000
mean2.781-2.774=0.007
σ0.014-0.022=-0.009
min2.764-2.753=0.010
max2.797-2.796=0.001
policies=200
mean17933.061-17849.728=83.332
σ0.461-0.432=0.029
min17932.804-17849.472=83.332
max17933.752-17850.375=83.378
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2769.000-2418.000=351.000
σ0.000
min2769.000-2418.000=351.000
max2769.000-2418.000=351.000
mean27.952-28.009=-0.058
σ0.130-0.229=-0.099
min27.797-27.764=0.033
max28.090-28.248=-0.158