Compare commits

Home / Compare 07ce6634 .. fd2eebdb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.782=0.001
σ0.046-0.045=0.001
min70.746-70.755=-0.009
max70.911-70.908=0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.160-0.159=0.001
σ0.003-0.004=-0.001
min0.158-0.152=0.005
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.492-21.494=-0.002
σ0.003-0.003=-0.000
min21.488-21.490=-0.002
max21.496-21.499=-0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.066-0.066=-0.000
σ0.002-0.003=-0.001
min0.064-0.065=-0.001
max0.073-0.075=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.093=-0.001
σ0.363-0.362=0.001
min1753.534-1753.536=-0.002
max1754.680-1754.678=0.002
mean1649.850-1642.150=7.700
σ610.670-604.214=6.456
min642.000
max2471.000-2455.000=16.000
mean2.823-2.791=0.032
σ0.173-0.201=-0.028
min2.279-2.271=0.008
max3.075-3.126=-0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.599-271.600=-0.001
σ0.006-0.006=-0.000
min271.593-271.594=-0.001
max271.608-271.608=0.000
mean2471.000-2455.000=16.000
σ0.000
min2471.000-2455.000=16.000
max2471.000-2455.000=16.000
mean0.386-0.383=0.003
σ0.005-0.002=0.003
min0.382-0.381=0.001
max0.394-0.385=0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.000-1932.006=-0.006
σ0.016-0.011=0.005
min1931.976-1931.991=-0.014
max1932.018-1932.021=-0.003
mean2471.000-2455.000=16.000
σ0.000
min2471.000-2455.000=16.000
max2471.000-2455.000=16.000
mean2.520-2.508=0.012
σ0.071-0.094=-0.023
min2.458-2.393=0.065
max2.633-2.623=0.010
iters=5
new-facts=6402
prior-facts=1
mean4752.502-4752.774=-0.272
σ1.177-0.844=0.333
min4751.106-4752.254=-1.148
max4754.367-4754.271=0.096
mean2471.000-2455.000=16.000
σ0.000
min2471.000-2455.000=16.000
max2471.000-2455.000=16.000
mean8.594-8.445=0.149
σ0.584-0.488=0.096
min7.698-7.851=-0.153
max9.056-8.945=0.111
iters=5
new-facts=6402
prior-facts=6402
mean4943.138-4943.138=-0.000
σ0.157-0.167=-0.010
min4942.858-4942.840=0.017
max4943.224-4943.233=-0.009
mean2996.200-3018.200=-22.000
σ299.547-263.245=36.303
min2589.000-2627.000=-38.000
max3363.000-3330.000=33.000
mean8.624-8.620=0.004
σ0.296-0.129=0.167
min8.354-8.445=-0.092
max9.084-8.746=0.338

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.779-1.726=0.053
σ0.131-0.123=0.008
min1.606-1.549=0.056
max1.917-1.819=0.098

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.626-468.632=-0.006
σ574.921-574.925=-0.004
min181.162-181.165=-0.003
max1331.007-1331.020=-0.013
mean88.250
σ8.500
min84.000
max101.000
mean2471.000-2455.000=16.000
σ0.000
min2471.000-2455.000=16.000
max2471.000-2455.000=16.000
mean0.565-0.553=0.012
σ0.547-0.518=0.028
min0.286-0.288=-0.002
max1.385-1.331=0.054
policies=20
mean1811.945-1811.964=-0.019
σ0.388-0.393=-0.005
min1811.679-1811.703=-0.024
max1812.517-1812.545=-0.028
mean840.000
σ0.000
min840.000
max840.000
mean2471.000-2455.000=16.000
σ0.000
min2471.000-2455.000=16.000
max2471.000-2455.000=16.000
mean2.853-2.846=0.007
σ0.013-0.027=-0.013
min2.844-2.818=0.026
max2.873-2.882=-0.009
policies=200
mean18126.477-18126.638=-0.160
σ0.469-0.590=-0.121
min18126.122-18126.241=-0.119
max18127.150-18127.497=-0.348
mean8400.000
σ0.000
min8400.000
max8400.000
mean2471.000-2455.000=16.000
σ0.000
min2471.000-2455.000=16.000
max2471.000-2455.000=16.000
mean28.716-28.691=0.026
σ0.074-0.036=0.037
min28.655-28.661=-0.006
max28.814-28.738=0.075