Compare commits

Home / Compare 036d0a5b .. bc451ce5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.567=-0.006
σ0.046-0.045=0.001
min70.535-70.542=-0.007
max70.692-70.693=-0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.160-0.160=-0.000
σ0.003-0.003=0.000
min0.157-0.156=0.000
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.004=-0.002
min21.285-21.282=0.003
max21.293-21.294=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.000
min0.063-0.063=-0.001
max0.071-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1753.374=-0.001
σ0.361-0.362=-0.002
min1752.803-1752.804=-0.001
max1753.959-1753.976=-0.017
mean1665.600-1650.350=15.250
σ637.384-647.345=-9.961
min680.000-632.000=48.000
max2694.000-2896.000=-202.000
mean2.747-2.765=-0.018
σ0.154-0.144=0.011
min2.443-2.492=-0.049
max2.976-2.961=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.753-271.758=-0.005
σ0.005-0.004=0.001
min271.747-271.752=-0.005
max271.761-271.763=-0.003
mean2694.000-2896.000=-202.000
σ0.000
min2694.000-2896.000=-202.000
max2694.000-2896.000=-202.000
mean0.381-0.382=-0.002
σ0.005-0.005=-0.000
min0.376-0.377=-0.001
max0.389-0.390=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.175-1932.180=-0.006
σ0.004-0.011=-0.007
min1932.169-1932.163=0.005
max1932.179-1932.193=-0.013
mean2694.000-2896.000=-202.000
σ0.000
min2694.000-2896.000=-202.000
max2694.000-2896.000=-202.000
mean3.050-2.938=0.113
σ0.112-0.181=-0.069
min2.970-2.629=0.341
max3.226-3.107=0.118
iters=5
new-facts=6402
prior-facts=1
mean4752.950-4752.928=0.022
σ0.794-0.840=-0.045
min4752.534-4752.430=0.103
max4754.367-4754.422=-0.055
mean2694.000-2896.000=-202.000
σ0.000
min2694.000-2896.000=-202.000
max2694.000-2896.000=-202.000
mean8.202-8.404=-0.202
σ0.378-0.460=-0.082
min7.588-7.666=-0.078
max8.563-8.938=-0.375
iters=5
new-facts=6402
prior-facts=6402
mean4943.374-4943.302=0.072
σ0.018-0.182=-0.164
min4943.351-4942.978=0.373
max4943.391-4943.395=-0.003
mean2979.200-3079.000=-99.800
σ240.839-200.821=40.018
min2694.000-2896.000=-202.000
max3314.000-3383.000=-69.000
mean8.549-8.577=-0.027
σ0.306-0.112=0.194
min8.369-8.463=-0.094
max9.092-8.701=0.391

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.081-1.120=-0.039
σ0.124-0.199=-0.075
min0.902-0.928=-0.027
max1.237-1.363=-0.126

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.854-472.861=-0.006
σ575.924-575.925=-0.002
min184.884-184.886=-0.002
max1336.740-1336.749=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2694.000-2896.000=-202.000
σ0.000
min2694.000-2896.000=-202.000
max2694.000-2896.000=-202.000
mean0.557-0.488=0.068
σ0.530-0.378=0.152
min0.289-0.298=-0.009
max1.351-1.055=0.297
policies=20
mean1849.171-1849.223=-0.052
σ0.370-0.372=-0.002
min1848.921-1848.942=-0.022
max1849.719-1849.763=-0.045
mean840.000
σ0.000
min840.000
max840.000
mean2694.000-2896.000=-202.000
σ0.000
min2694.000-2896.000=-202.000
max2694.000-2896.000=-202.000
mean2.860-2.950=-0.089
σ0.018-0.013=0.005
min2.838-2.936=-0.098
max2.883-2.966=-0.084
policies=200
mean18498.687-18498.664=0.022
σ0.529-0.539=-0.011
min18498.263-18498.192=0.071
max18499.455-18499.424=0.032
mean8400.000
σ0.000
min8400.000
max8400.000
mean2694.000-2896.000=-202.000
σ0.000
min2694.000-2896.000=-202.000
max2694.000-2896.000=-202.000
mean28.657-29.181=-0.525
σ0.087-0.501=-0.414
min28.563-28.745=-0.182
max28.759-29.662=-0.904