Compare commits

Home / Compare c5b5b55d .. 9f2509fd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean55.691-92.523=-36.832
σ0.053-0.054=-0.001
min55.657-92.467=-36.810
max55.838-92.665=-36.827
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.138-0.213=-0.075
σ0.005-0.005=-0.001
min0.134-0.200=-0.067
max0.145-0.220=-0.076
cache=y
dps=1
iters=10
policies=100
mean44.203-43.138=1.065
σ0.005-0.007=-0.003
min44.197-43.126=1.071
max44.212-43.150=1.062
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.120-0.112=0.007
σ0.004-0.003=0.001
min0.115-0.109=0.005
max0.126-0.118=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1763.721-1761.434=2.287
σ0.366-0.363=0.003
min1763.144-1760.856=2.288
max1764.304-1762.025=2.278
mean1648.650-1670.950=-22.300
σ635.220-641.983=-6.763
min644.000-621.000=23.000
max2836.000-2788.000=48.000
mean2.355-2.546=-0.191
σ0.114-0.281=-0.167
min2.201-2.164=0.037
max2.677-2.959=-0.282

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean343.136-328.772=14.364
σ0.070-0.054=0.016
min343.012-328.676=14.336
max343.179-328.806=14.373
mean2836.000-2788.000=48.000
σ0.000
min2836.000-2788.000=48.000
max2836.000-2788.000=48.000
mean0.442-0.447=-0.005
σ0.006-0.011=-0.005
min0.437-0.433=0.004
max0.450-0.458=-0.008
iters=5
new-facts=1
prior-facts=6402
mean2003.698-1989.319=14.378
σ0.021-0.013=0.008
min2003.670-1989.306=14.363
max2003.718-1989.334=14.383
mean2836.000-2788.000=48.000
σ0.000
min2836.000-2788.000=48.000
max2836.000-2788.000=48.000
mean2.668-3.079=-0.410
σ0.148-0.052=0.096
min2.508-3.025=-0.517
max2.849-3.163=-0.315
iters=5
new-facts=6402
prior-facts=1
mean4827.302-4813.059=14.243
σ7.829-7.798=0.031
min4823.197-4809.425=13.772
max4841.290-4827.006=14.284
mean2836.000-2788.000=48.000
σ0.000
min2836.000-2788.000=48.000
max2836.000-2788.000=48.000
mean8.446-8.507=-0.062
σ0.861-0.524=0.337
min7.774-7.683=0.090
max9.460-9.134=0.326
iters=5
new-facts=6402
prior-facts=6402
mean5014.772-5000.516=14.256
σ0.336-0.160=0.177
min5014.171-5000.233=13.939
max5014.942-5000.608=14.334
mean3062.600-3052.600=10.000
σ296.872-237.106=59.766
min2836.000-2788.000=48.000
max3520.000-3359.000=161.000
mean8.492-8.890=-0.398
σ0.116-0.439=-0.324
min8.375-8.463=-0.088
max8.667-9.548=-0.882

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.980-1.014=-0.034
σ0.068-0.140=-0.072
min0.920-0.920=-0.001
max1.058-1.240=-0.182

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.048-470.847=-5.799
σ574.248-574.236=0.013
min177.922-183.719=-5.797
max1326.421-1332.200=-5.780
mean88.250-90.250=-2.000
σ8.500
min84.000-86.000=-2.000
max101.000-103.000=-2.000
mean2836.000-2788.000=48.000
σ0.000
min2836.000-2788.000=48.000
max2836.000-2788.000=48.000
mean0.402-0.444=-0.042
σ0.224-0.297=-0.074
min0.288-0.292=-0.004
max0.737-0.890=-0.153
policies=20
mean1779.485-1837.494=-58.009
σ0.367-0.406=-0.039
min1779.268-1837.215=-57.948
max1780.032-1838.091=-58.059
mean840.000-860.000=-20.000
σ0.000
min840.000-860.000=-20.000
max840.000-860.000=-20.000
mean2836.000-2788.000=48.000
σ0.000
min2836.000-2788.000=48.000
max2836.000-2788.000=48.000
mean2.829-2.968=-0.139
σ0.022-0.082=-0.060
min2.796-2.923=-0.127
max2.842-3.092=-0.249
policies=200
mean17801.137-18381.805=-580.667
σ0.714-0.424=0.290
min17800.180-18381.512=-581.332
max17801.706-18382.434=-580.728
mean8400.000-8600.000=-200.000
σ0.000
min8400.000-8600.000=-200.000
max8400.000-8600.000=-200.000
mean2836.000-2788.000=48.000
σ0.000
min2836.000-2788.000=48.000
max2836.000-2788.000=48.000
mean28.371-28.625=-0.253
σ0.375-0.052=0.323
min28.054-28.547=-0.493
max28.817-28.661=0.156