Compare commits

Home / Compare a15d4236 .. 207ab445

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.788-70.787=0.000
σ0.044-0.048=-0.004
min70.757-70.757=0.000
max70.909-70.921=-0.012
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.160-0.160=-0.000
σ0.003-0.003=0.000
min0.157-0.158=-0.001
max0.167-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.496-21.495=0.001
σ0.002-0.004=-0.001
min21.491-21.489=0.002
max21.499-21.501=-0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.064-0.065=-0.000
σ0.003-0.004=-0.001
min0.060-0.059=0.001
max0.071-0.075=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.094=-0.001
σ0.363-0.362=0.001
min1753.523-1753.529=-0.006
max1754.679-1754.679=0.001
mean1662.750-1661.550=1.200
σ631.757-633.055=-1.297
min671.000-626.000=45.000
max2702.000-2756.000=-54.000
mean2.798-2.802=-0.004
σ0.120-0.158=-0.038
min2.521-2.384=0.138
max2.966-3.031=-0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.957=-0.001
σ0.006-0.009=-0.002
min271.947-271.946=0.002
max271.962-271.964=-0.002
mean2702.000-2756.000=-54.000
σ0.000
min2702.000-2756.000=-54.000
max2702.000-2756.000=-54.000
mean0.380-0.386=-0.005
σ0.002-0.007=-0.005
min0.378-0.379=-0.001
max0.383-0.395=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1932.321-1932.319=0.002
σ0.008-0.006=0.002
min1932.310-1932.315=-0.005
max1932.332-1932.329=0.003
mean2702.000-2756.000=-54.000
σ0.000
min2702.000-2756.000=-54.000
max2702.000-2756.000=-54.000
mean3.057-2.997=0.060
σ0.069-0.059=0.010
min2.978-2.910=0.068
max3.146-3.073=0.072
iters=5
new-facts=6402
prior-facts=1
mean4753.126-4752.935=0.191
σ0.825-0.998=-0.173
min4752.638-4752.085=0.552
max4754.592-4754.664=-0.072
mean2702.000-2756.000=-54.000
σ0.000
min2702.000-2756.000=-54.000
max2702.000-2756.000=-54.000
mean8.427-8.779=-0.352
σ0.621-0.237=0.385
min7.611-8.518=-0.907
max9.110-9.065=0.045
iters=5
new-facts=6402
prior-facts=6402
mean4943.553-4943.557=-0.004
σ0.022-0.018=0.004
min4943.529-4943.542=-0.013
max4943.578-4943.581=-0.003
mean3002.000-2998.800=3.200
σ252.790-222.227=30.564
min2702.000-2756.000=-54.000
max3323.000-3322.000=1.000
mean8.549-8.508=0.041
σ0.164-0.146=0.018
min8.400-8.352=0.049
max8.782-8.668=0.114

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.155-1.025=0.130
σ0.214-0.132=0.082
min0.934-0.935=-0.001
max1.491-1.237=0.253

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.666-468.668=-0.002
σ574.940-574.938=0.002
min181.189-181.194=-0.004
max1331.076-1331.075=0.001
mean88.250
σ8.500
min84.000
max101.000
mean2702.000-2756.000=-54.000
σ0.000
min2702.000-2756.000=-54.000
max2702.000-2756.000=-54.000
mean0.584-0.566=0.018
σ0.590-0.549=0.041
min0.284-0.289=-0.005
max1.469-1.390=0.080
policies=20
mean1812.223-1812.230=-0.007
σ0.390-0.385=0.005
min1811.962-1811.968=-0.006
max1812.800-1812.798=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2702.000-2756.000=-54.000
σ0.000
min2702.000-2756.000=-54.000
max2702.000-2756.000=-54.000
mean2.838-2.843=-0.005
σ0.017-0.020=-0.004
min2.823-2.824=-0.001
max2.853-2.863=-0.009
policies=200
mean18129.341-18129.359=-0.018
σ0.535-0.439=0.096
min18129.010-18129.026=-0.017
max18130.140-18130.004=0.136
mean8400.000
σ0.000
min8400.000
max8400.000
mean2702.000-2756.000=-54.000
σ0.000
min2702.000-2756.000=-54.000
max2702.000-2756.000=-54.000
mean28.554-28.602=-0.048
σ0.037-0.093=-0.057
min28.523-28.512=0.011
max28.606-28.716=-0.109