Compare commits

Home / Compare 341ece92 .. c7f25a55

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.783=-0.001
σ0.047-0.046=0.001
min70.747-70.746=0.001
max70.911-70.911=0.000
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.158-0.160=-0.002
σ0.005-0.003=0.002
min0.151-0.158=-0.006
max0.164-0.167=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=-0.000
σ0.002-0.003=-0.000
min21.489-21.488=0.001
max21.496-21.496=0.000
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.067-0.066=0.001
σ0.003-0.002=0.001
min0.064-0.064=-0.000
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.092=0.001
σ0.361-0.363=-0.002
min1753.533-1753.534=-0.001
max1754.678-1754.680=-0.001
mean1673.550-1649.850=23.700
σ642.540-610.670=31.870
min672.000-642.000=30.000
max2649.000-2471.000=178.000
mean2.758-2.823=-0.064
σ0.238-0.173=0.065
min2.259-2.279=-0.021
max3.136-3.075=0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.599-271.599=-0.000
σ0.006-0.006=-0.000
min271.590-271.593=-0.003
max271.604-271.608=-0.004
mean2649.000-2471.000=178.000
σ0.000
min2649.000-2471.000=178.000
max2649.000-2471.000=178.000
mean0.385-0.386=-0.002
σ0.004-0.005=-0.001
min0.381-0.382=-0.000
max0.391-0.394=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1931.982-1932.000=-0.018
σ0.019-0.016=0.003
min1931.957-1931.976=-0.019
max1932.006-1932.018=-0.012
mean2649.000-2471.000=178.000
σ0.000
min2649.000-2471.000=178.000
max2649.000-2471.000=178.000
mean2.536-2.520=0.016
σ0.112-0.071=0.041
min2.412-2.458=-0.046
max2.699-2.633=0.067
iters=5
new-facts=6402
prior-facts=1
mean4752.724-4752.502=0.222
σ0.912-1.177=-0.265
min4752.245-4751.106=1.138
max4754.350-4754.367=-0.017
mean2649.000-2471.000=178.000
σ0.000
min2649.000-2471.000=178.000
max2649.000-2471.000=178.000
mean8.722-8.594=0.128
σ0.338-0.584=-0.247
min8.287-7.698=0.589
max9.097-9.056=0.042
iters=5
new-facts=6402
prior-facts=6402
mean4943.210-4943.138=0.072
σ0.015-0.157=-0.142
min4943.192-4942.858=0.334
max4943.222-4943.224=-0.003
mean2953.800-2996.200=-42.400
σ334.478-299.547=34.931
min2649.000-2589.000=60.000
max3430.000-3363.000=67.000
mean8.496-8.624=-0.127
σ0.117-0.296=-0.179
min8.394-8.354=0.040
max8.690-9.084=-0.394

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.222-1.779=-0.557
σ0.322-0.131=0.191
min0.945-1.606=-0.661
max1.732-1.917=-0.185

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.633-468.626=0.007
σ574.936-574.921=0.015
min181.162-181.162=0.000
max1331.036-1331.007=0.029
mean88.250
σ8.500
min84.000
max101.000
mean2649.000-2471.000=178.000
σ0.000
min2649.000-2471.000=178.000
max2649.000-2471.000=178.000
mean0.559-0.565=-0.006
σ0.544-0.547=-0.003
min0.286-0.286=-0.000
max1.375-1.385=-0.010
policies=20
mean1811.952-1811.945=0.007
σ0.396-0.388=0.007
min1811.676-1811.679=-0.003
max1812.535-1812.517=0.018
mean840.000
σ0.000
min840.000
max840.000
mean2649.000-2471.000=178.000
σ0.000
min2649.000-2471.000=178.000
max2649.000-2471.000=178.000
mean2.856-2.853=0.003
σ0.014-0.013=0.000
min2.842-2.844=-0.001
max2.875-2.873=0.002
policies=200
mean18126.467-18126.477=-0.010
σ0.590-0.469=0.121
min18126.112-18126.122=-0.011
max18127.350-18127.150=0.201
mean8400.000
σ0.000
min8400.000
max8400.000
mean2649.000-2471.000=178.000
σ0.000
min2649.000-2471.000=178.000
max2649.000-2471.000=178.000
mean28.722-28.716=0.006
σ0.037-0.074=-0.037
min28.674-28.655=0.019
max28.759-28.814=-0.055