Compare commits

Home / Compare da63dbfc .. 14f31e11

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean55.030-54.430=0.600
σ0.052-0.050=0.002
min54.992-54.388=0.604
max55.171-54.568=0.604
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.140-0.135=0.005
σ0.004-0.005=-0.001
min0.135-0.127=0.008
max0.146-0.143=0.003
cache=y
dps=1
iters=10
policies=100
mean44.362-43.761=0.601
σ0.003-0.005=-0.002
min44.357-43.751=0.606
max44.368-43.770=0.599
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.121-0.118=0.003
σ0.003-0.005=-0.003
min0.119-0.111=0.008
max0.127-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1767.107-1764.657=2.450
σ0.366-0.369=-0.003
min1766.532-1764.082=2.450
max1767.704-1765.258=2.446
mean1646.050-1646.250=-0.200
σ622.197-629.301=-7.105
min647.000-626.000=21.000
max2504.000-2758.000=-254.000
mean2.339-2.494=-0.154
σ0.088-0.237=-0.150
min2.247-2.275=-0.028
max2.663-3.078=-0.416

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean350.631-345.007=5.624
σ0.068-0.070=-0.002
min350.512-344.883=5.630
max350.678-345.052=5.627
mean2504.000-2758.000=-254.000
σ0.000
min2504.000-2758.000=-254.000
max2504.000-2758.000=-254.000
mean0.456-0.449=0.007
σ0.006-0.006=0.000
min0.452-0.444=0.008
max0.466-0.459=0.008
iters=5
new-facts=1
prior-facts=6402
mean2012.702-2007.179=5.522
σ0.024-0.011=0.013
min2012.662-2007.169=5.493
max2012.722-2007.196=5.526
mean2504.000-2758.000=-254.000
σ0.000
min2504.000-2758.000=-254.000
max2504.000-2758.000=-254.000
mean2.754-2.683=0.071
σ0.087-0.096=-0.010
min2.677-2.530=0.147
max2.893-2.782=0.111
iters=5
new-facts=6402
prior-facts=1
mean4837.590-4831.942=5.648
σ7.775-7.789=-0.014
min4833.748-4828.166=5.583
max4851.493-4845.873=5.620
mean2504.000-2758.000=-254.000
σ0.000
min2504.000-2758.000=-254.000
max2504.000-2758.000=-254.000
mean8.221-8.583=-0.362
σ0.421-0.573=-0.152
min7.881-7.915=-0.033
max8.955-9.086=-0.131
iters=5
new-facts=6402
prior-facts=6402
mean5025.193-5019.579=5.615
σ0.025-0.011=0.014
min5025.157-5019.567=5.590
max5025.218-5019.593=5.624
mean2963.400-3028.400=-65.000
σ420.862-264.542=156.320
min2504.000-2758.000=-254.000
max3539.000-3400.000=139.000
mean9.299-9.805=-0.506
σ0.588-0.127=0.461
min8.658-9.662=-1.005
max9.862-9.988=-0.126

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.461-1.096=0.365
σ0.161-0.251=-0.090
min1.226-0.921=0.305
max1.673-1.530=0.143

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean469.015-466.520=2.495
σ574.771-574.776=-0.005
min181.627-179.124=2.503
max1331.172-1328.685=2.487
mean90.250
σ8.500
min86.000
max103.000
mean2504.000-2758.000=-254.000
σ0.000
min2504.000-2758.000=-254.000
max2504.000-2758.000=-254.000
mean0.545-0.439=0.106
σ0.524-0.306=0.217
min0.282-0.284=-0.002
max1.331-0.899=0.432
policies=20
mean1816.597-1791.562=25.035
σ0.395-0.373=0.023
min1816.318-1791.281=25.037
max1817.181-1792.107=25.074
mean860.000
σ0.000
min860.000
max860.000
mean2504.000-2758.000=-254.000
σ0.000
min2504.000-2758.000=-254.000
max2504.000-2758.000=-254.000
mean2.814-2.824=-0.010
σ0.018-0.016=0.002
min2.803-2.802=0.001
max2.841-2.840=0.001
policies=200
mean18173.159-17922.949=250.211
σ0.518-0.523=-0.005
min18172.822-17922.509=250.313
max18173.919-17923.707=250.211
mean8600.000
σ0.000
min8600.000
max8600.000
mean2504.000-2758.000=-254.000
σ0.000
min2504.000-2758.000=-254.000
max2504.000-2758.000=-254.000
mean28.121-27.916=0.205
σ0.205-0.077=0.128
min27.962-27.815=0.147
max28.421-28.001=0.420