Compare commits

Home / Compare 207ab445 .. 91eadc06

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.786-70.788=-0.002
σ0.045-0.044=0.001
min70.758-70.757=0.001
max70.911-70.909=0.002
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.154-0.160=-0.006
σ0.004-0.003=0.001
min0.150-0.157=-0.007
max0.160-0.167=-0.007
cache=y
dps=1
iters=10
policies=100
mean21.496-21.496=-0.000
σ0.003-0.002=0.000
min21.492-21.491=0.001
max21.499-21.499=0.000
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.062-0.064=-0.002
σ0.003-0.003=0.001
min0.059-0.060=-0.001
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.093=-0.001
σ0.359-0.363=-0.003
min1753.530-1753.523=0.007
max1754.681-1754.679=0.002
mean1648.100-1662.750=-14.650
σ610.775-631.757=-20.983
min635.000-671.000=-36.000
max2471.000-2702.000=-231.000
mean2.760-2.798=-0.038
σ0.207-0.120=0.087
min2.364-2.521=-0.157
max3.227-2.966=0.261

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.956=0.000
σ0.008-0.006=0.002
min271.946-271.947=-0.001
max271.966-271.962=0.004
mean2471.000-2702.000=-231.000
σ0.000
min2471.000-2702.000=-231.000
max2471.000-2702.000=-231.000
mean0.390-0.380=0.009
σ0.010-0.002=0.008
min0.380-0.378=0.002
max0.399-0.383=0.017
iters=5
new-facts=1
prior-facts=6402
mean1932.321-1932.321=-0.000
σ0.011-0.008=0.003
min1932.309-1932.310=-0.001
max1932.335-1932.332=0.004
mean2471.000-2702.000=-231.000
σ0.000
min2471.000-2702.000=-231.000
max2471.000-2702.000=-231.000
mean2.925-3.057=-0.132
σ0.257-0.069=0.188
min2.479-2.978=-0.499
max3.142-3.146=-0.004
iters=5
new-facts=6402
prior-facts=1
mean4753.073-4753.126=-0.053
σ0.923-0.825=0.099
min4752.572-4752.638=-0.065
max4754.720-4754.592=0.128
mean2471.000-2702.000=-231.000
σ0.000
min2471.000-2702.000=-231.000
max2471.000-2702.000=-231.000
mean8.710-8.427=0.282
σ0.301-0.621=-0.320
min8.368-7.611=0.757
max9.038-9.110=-0.072
iters=5
new-facts=6402
prior-facts=6402
mean4943.554-4943.553=0.001
σ0.024-0.022=0.002
min4943.535-4943.529=0.006
max4943.586-4943.578=0.007
mean3001.200-3002.000=-0.800
σ279.158-252.790=26.368
min2613.000-2702.000=-89.000
max3312.000-3323.000=-11.000
mean8.453-8.549=-0.096
σ0.087-0.164=-0.077
min8.345-8.400=-0.055
max8.588-8.782=-0.194

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.710-1.155=0.555
σ0.125-0.214=-0.089
min1.520-0.934=0.586
max1.843-1.491=0.352

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.654-468.666=-0.012
σ574.926-574.940=-0.014
min181.188-181.189=-0.002
max1331.043-1331.076=-0.033
mean88.250
σ8.500
min84.000
max101.000
mean2471.000-2702.000=-231.000
σ0.000
min2471.000-2702.000=-231.000
max2471.000-2702.000=-231.000
mean0.570-0.584=-0.014
σ0.564-0.590=-0.026
min0.281-0.284=-0.003
max1.416-1.469=-0.053
policies=20
mean1812.179-1812.223=-0.044
σ0.388-0.390=-0.002
min1811.927-1811.962=-0.035
max1812.755-1812.800=-0.045
mean840.000
σ0.000
min840.000
max840.000
mean2471.000-2702.000=-231.000
σ0.000
min2471.000-2702.000=-231.000
max2471.000-2702.000=-231.000
mean2.825-2.838=-0.013
σ0.016-0.017=-0.001
min2.808-2.823=-0.015
max2.844-2.853=-0.010
policies=200
mean18129.154-18129.341=-0.187
σ0.434-0.535=-0.101
min18128.861-18129.010=-0.148
max18129.796-18130.140=-0.344
mean8400.000
σ0.000
min8400.000
max8400.000
mean2471.000-2702.000=-231.000
σ0.000
min2471.000-2702.000=-231.000
max2471.000-2702.000=-231.000
mean28.528-28.554=-0.027
σ0.077-0.037=0.040
min28.430-28.523=-0.094
max28.597-28.606=-0.009