Compare commits

Home / Compare 7bd20b40 .. e69533ae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.558-70.384=0.174
σ0.048-0.044=0.005
min70.530-70.354=0.176
max70.693-70.506=0.187
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.160-0.162=-0.002
σ0.003-0.002=0.001
min0.155-0.160=-0.005
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.141=0.146
σ0.003-0.003=0.000
min21.283-21.137=0.146
max21.291-21.146=0.145
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.065-0.064=0.000
σ0.002-0.002=0.001
min0.064-0.063=0.001
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.067-1752.391=0.676
σ0.362-0.362=-0.000
min1752.501-1751.824=0.677
max1753.652-1752.976=0.676
mean1657.600-1656.650=0.950
σ631.866-638.794=-6.928
min617.000-619.000=-2.000
max2767.000-2789.000=-22.000
mean2.747-2.817=-0.069
σ0.181-0.183=-0.002
min2.150-2.295=-0.146
max2.915-3.144=-0.229

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.290-270.118=1.172
σ0.004-0.005=-0.001
min271.286-270.112=1.174
max271.297-270.124=1.174
mean2767.000-2789.000=-22.000
σ0.000
min2767.000-2789.000=-22.000
max2767.000-2789.000=-22.000
mean0.384-0.381=0.003
σ0.006-0.006=-0.000
min0.379-0.373=0.006
max0.392-0.389=0.003
iters=5
new-facts=1
prior-facts=6402
mean1931.710-1930.602=1.108
σ0.010-0.004=0.006
min1931.694-1930.596=1.098
max1931.720-1930.608=1.112
mean2767.000-2789.000=-22.000
σ0.000
min2767.000-2789.000=-22.000
max2767.000-2789.000=-22.000
mean3.047-2.598=0.449
σ0.122-0.149=-0.027
min2.906-2.477=0.429
max3.214-2.810=0.404
iters=5
new-facts=6402
prior-facts=1
mean4752.471-4751.185=1.286
σ0.858-0.933=-0.075
min4751.997-4750.305=1.692
max4753.999-4752.777=1.222
mean2767.000-2789.000=-22.000
σ0.000
min2767.000-2789.000=-22.000
max2767.000-2789.000=-22.000
mean8.364-8.366=-0.002
σ0.394-0.443=-0.050
min7.795-7.622=0.172
max8.835-8.716=0.119
iters=5
new-facts=6402
prior-facts=6402
mean4942.772-4941.762=1.010
σ0.188-0.030=0.158
min4942.555-4941.728=0.828
max4942.914-4941.798=1.116
mean3037.600-3021.000=16.600
σ210.007-222.043=-12.036
min2767.000-2789.000=-22.000
max3321.000-3318.000=3.000
mean8.535-8.549=-0.014
σ0.165-0.151=0.014
min8.372-8.398=-0.026
max8.715-8.763=-0.048

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.015-1.080=-0.066
σ0.132-0.177=-0.045
min0.928-0.940=-0.012
max1.234-1.374=-0.140

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.029-466.375=0.655
σ575.927-575.942=-0.015
min179.057-178.398=0.659
max1330.920-1330.287=0.633
mean84.250
σ8.500
min80.000
max97.000
mean2767.000-2789.000=-22.000
σ0.000
min2767.000-2789.000=-22.000
max2767.000-2789.000=-22.000
mean0.470-0.442=0.028
σ0.378-0.306=0.072
min0.278-0.284=-0.006
max1.038-0.901=0.137
policies=20
mean1790.875-1784.342=6.533
σ0.347-0.355=-0.009
min1790.639-1784.084=6.555
max1791.391-1784.864=6.527
mean800.000
σ0.000
min800.000
max800.000
mean2767.000-2789.000=-22.000
σ0.000
min2767.000-2789.000=-22.000
max2767.000-2789.000=-22.000
mean2.773-2.857=-0.084
σ0.013-0.107=-0.094
min2.760-2.781=-0.021
max2.790-3.009=-0.219
policies=200
mean17915.278-17849.781=65.497
σ0.463-0.476=-0.012
min17914.879-17849.516=65.363
max17915.946-17850.492=65.453
mean8000.000
σ0.000
min8000.000
max8000.000
mean2767.000-2789.000=-22.000
σ0.000
min2767.000-2789.000=-22.000
max2767.000-2789.000=-22.000
mean28.083-27.984=0.099
σ0.197-0.057=0.140
min27.880-27.945=-0.065
max28.323-28.068=0.255