Compare commits

Home / Compare 5b072685 .. c13612b4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.563=0.004
σ0.047-0.046=0.001
min70.541-70.537=0.004
max70.695-70.693=0.002
mean413.000-416.900=-3.900
σ0.000-0.316=-0.316
min413.000-416.000=-3.000
max413.000-417.000=-4.000
mean0.159-0.159=0.000
σ0.004-0.004=-0.000
min0.155-0.153=0.002
max0.166-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.002=0.001
min21.283-21.285=-0.002
max21.294-21.291=0.003
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.065-0.064=0.000
σ0.003-0.003=0.000
min0.063-0.063=0.000
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.567=0.003
σ0.362-0.359=0.003
min1752.999-1752.995=0.003
max1754.154-1754.133=0.021
mean1652.150-1669.650=-17.500
σ638.844-644.481=-5.638
min625.000-692.000=-67.000
max2851.000-2767.000=84.000
mean2.807-2.775=0.032
σ0.124-0.181=-0.057
min2.489-2.249=0.240
max2.971-2.980=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.019-272.015=0.004
σ0.007-0.005=0.003
min272.011-272.011=0.000
max272.028-272.022=0.006
mean2851.000-2767.000=84.000
σ0.000
min2851.000-2767.000=84.000
max2851.000-2767.000=84.000
mean0.391-0.389=0.002
σ0.005-0.013=-0.008
min0.381-0.372=0.009
max0.395-0.404=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.435-1932.430=0.005
σ0.008-0.014=-0.006
min1932.422-1932.410=0.012
max1932.443-1932.442=0.001
mean2851.000-2767.000=84.000
σ0.000
min2851.000-2767.000=84.000
max2851.000-2767.000=84.000
mean3.021-3.009=0.012
σ0.094-0.043=0.051
min2.937-2.959=-0.023
max3.180-3.066=0.113
iters=5
new-facts=6402
prior-facts=1
mean4753.108-4753.193=-0.086
σ0.564-0.857=-0.293
min4752.807-4752.755=0.052
max4754.112-4754.723=-0.611
mean2851.000-2767.000=84.000
σ0.000
min2851.000-2767.000=84.000
max2851.000-2767.000=84.000
mean8.258-8.354=-0.097
σ0.397-0.344=0.054
min7.775-7.845=-0.069
max8.598-8.774=-0.177
iters=5
new-facts=6402
prior-facts=6402
mean4943.629-4943.632=-0.003
σ0.028-0.013=0.015
min4943.588-4943.619=-0.031
max4943.657-4943.650=0.007
mean3073.000-3036.000=37.000
σ226.723-228.980=-2.257
min2851.000-2767.000=84.000
max3406.000-3309.000=97.000
mean8.535-8.606=-0.071
σ0.149-0.195=-0.046
min8.411-8.404=0.008
max8.766-8.871=-0.105

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.057-1.028=0.028
σ0.265-0.092=0.173
min0.931-0.927=0.003
max1.530-1.144=0.386

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.111-473.112=-0.001
σ575.926-575.938=-0.012
min185.138-185.139=-0.001
max1337.000-1337.019=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2851.000-2767.000=84.000
σ0.000
min2851.000-2767.000=84.000
max2851.000-2767.000=84.000
mean0.450-0.551=-0.101
σ0.300-0.520=-0.220
min0.296-0.290=0.006
max0.899-1.331=-0.432
policies=20
mean1851.714-1851.618=0.096
σ0.379-0.305=0.074
min1851.420-1851.386=0.033
max1852.264-1852.064=0.200
mean840.000
σ0.000
min840.000
max840.000
mean2851.000-2767.000=84.000
σ0.000
min2851.000-2767.000=84.000
max2851.000-2767.000=84.000
mean2.952-2.885=0.067
σ0.010-0.014=-0.004
min2.942-2.865=0.077
max2.963-2.894=0.068
policies=200
mean18523.596-18523.448=0.148
σ0.343-0.480=-0.137
min18523.294-18523.131=0.164
max18524.081-18524.159=-0.078
mean8400.000
σ0.000
min8400.000
max8400.000
mean2851.000-2767.000=84.000
σ0.000
min2851.000-2767.000=84.000
max2851.000-2767.000=84.000
mean29.224-28.829=0.395
σ0.413-0.112=0.301
min28.821-28.733=0.088
max29.752-28.987=0.765