Compare commits

Home / Compare 08fe7d4f .. 0f2303b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.395-35.799=34.596
σ0.045-0.106=-0.060
min70.369-35.750=34.619
max70.519-36.099=34.420
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.157-0.077=0.080
σ0.004-0.004=0.000
min0.153-0.075=0.078
max0.163-0.084=0.079
cache=y
dps=1
iters=10
policies=100
mean21.145-26.065=-4.920
σ0.003-0.003=-0.000
min21.140-26.060=-4.920
max21.150-26.069=-4.920
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.062=0.002
σ0.002-0.002=0.000
min0.063-0.060=0.003
max0.071-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.698-1755.923=-3.226
σ0.363-0.368=-0.005
min1752.124-1755.352=-3.228
max1753.278-1756.513=-3.235
mean1655.200-1645.050=10.150
σ631.099-623.021=8.078
min688.000-611.000=77.000
max2766.000-2650.000=116.000
mean2.786-2.850=-0.064
σ0.157-0.182=-0.025
min2.397-2.303=0.095
max3.010-3.141=-0.131

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.610-277.195=-6.585
σ0.009-0.005=0.003
min270.597-277.188=-6.590
max270.618-277.202=-6.585
mean2766.000-2650.000=116.000
σ0.000
min2766.000-2650.000=116.000
max2766.000-2650.000=116.000
mean0.381-0.397=-0.016
σ0.010-0.008=0.003
min0.371-0.392=-0.021
max0.399-0.411=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1931.040-2174.430=-243.390
σ0.006-0.005=0.001
min1931.030-2174.425=-243.395
max1931.046-2174.436=-243.390
mean2766.000-2650.000=116.000
σ0.000
min2766.000-2650.000=116.000
max2766.000-2650.000=116.000
mean3.037-3.055=-0.017
σ0.073-0.146=-0.072
min2.974-2.809=0.165
max3.123-3.199=-0.076
iters=5
new-facts=6402
prior-facts=1
mean4751.743-5052.638=-300.896
σ0.911-0.962=-0.050
min4751.293-5052.036=-300.743
max4753.371-5054.344=-300.973
mean2766.000-2650.000=116.000
σ0.000
min2766.000-2650.000=116.000
max2766.000-2650.000=116.000
mean8.669-8.698=-0.028
σ0.265-0.476=-0.211
min8.375-8.257=0.117
max8.949-9.409=-0.460
iters=5
new-facts=6402
prior-facts=6402
mean4942.164-5188.420=-246.256
σ0.147-0.091=0.056
min4941.902-5188.349=-246.446
max4942.243-5188.521=-246.278
mean3053.200-3233.000=-179.800
σ248.886-385.841=-136.955
min2766.000-2696.000=70.000
max3409.000-3720.000=-311.000
mean8.617-8.992=-0.374
σ0.222-0.407=-0.186
min8.389-8.725=-0.336
max8.865-9.701=-0.836

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.204=-0.207
σ0.139-0.294=-0.155
min0.929-0.950=-0.021
max1.245-1.702=-0.456

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.209-464.854=2.355
σ575.932-572.657=3.274
min179.233-178.523=0.710
max1331.107-1323.840=7.266
mean86.250-79.500=6.750
σ8.500-7.000=1.500
min82.000-76.000=6.000
max99.000-90.000=9.000
mean2766.000-2650.000=116.000
σ0.000
min2766.000-2650.000=116.000
max2766.000-2650.000=116.000
mean0.471-0.583=-0.112
σ0.374-0.587=-0.213
min0.283-0.283=0.001
max1.033-1.464=-0.431
policies=20
mean1792.627-1785.488=7.140
σ0.354-0.343=0.011
min1792.379-1785.260=7.119
max1793.152-1785.997=7.155
mean820.000-760.000=60.000
σ0.000
min820.000-760.000=60.000
max820.000-760.000=60.000
mean2766.000-2650.000=116.000
σ0.000
min2766.000-2650.000=116.000
max2766.000-2650.000=116.000
mean2.801-2.792=0.010
σ0.005-0.012=-0.007
min2.796-2.780=0.016
max2.807-2.806=0.001
policies=200
mean17933.053-17861.546=71.507
σ0.534-0.455=0.080
min17932.701-17861.268=71.433
max17933.848-17862.224=71.624
mean8200.000-7600.000=600.000
σ0.000
min8200.000-7600.000=600.000
max8200.000-7600.000=600.000
mean2766.000-2650.000=116.000
σ0.000
min2766.000-2650.000=116.000
max2766.000-2650.000=116.000
mean28.048-28.287=-0.239
σ0.042-0.149=-0.107
min28.004-28.127=-0.123
max28.105-28.427=-0.322