Compare commits

Home / Compare bbc400ec .. 1d225361

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.565=0.164
σ0.046-0.047=-0.001
min70.699-70.536=0.163
max70.857-70.692=0.165
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.160-0.158=0.002
σ0.003-0.005=-0.002
min0.156-0.151=0.005
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.446-21.288=0.158
σ0.003-0.002=0.001
min21.441-21.284=0.157
max21.450-21.291=0.158
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.063-0.065=-0.003
σ0.003-0.002=0.001
min0.059-0.064=-0.005
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1753.570=0.957
σ0.362-0.361=0.002
min1753.956-1752.992=0.964
max1755.112-1754.153=0.960
mean1659.950-1655.200=4.750
σ627.898-628.455=-0.556
min626.000-642.000=-16.000
max2853.000-2856.000=-3.000
mean2.801-2.755=0.046
σ0.127-0.230=-0.102
min2.401-2.229=0.173
max2.955-3.051=-0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.593-272.015=1.578
σ0.017-0.005=0.013
min273.575-272.007=1.568
max273.619-272.019=1.601
mean2853.000-2856.000=-3.000
σ0.000
min2853.000-2856.000=-3.000
max2853.000-2856.000=-3.000
mean0.390-0.385=0.005
σ0.006-0.006=0.000
min0.384-0.380=0.004
max0.399-0.394=0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.993-1932.437=1.556
σ0.006-0.011=-0.005
min1933.986-1932.424=1.562
max1934.004-1932.453=1.550
mean2853.000-2856.000=-3.000
σ0.000
min2853.000-2856.000=-3.000
max2853.000-2856.000=-3.000
mean3.050-2.971=0.079
σ0.198-0.065=0.133
min2.763-2.889=-0.126
max3.234-3.063=0.171
iters=5
new-facts=6402
prior-facts=1
mean4614.225-4752.925=-138.700
σ314.655-1.002=313.653
min4051.356-4752.118=-700.762
max4756.350-4754.604=1.746
mean2853.000-2856.000=-3.000
σ0.000
min2853.000-2856.000=-3.000
max2853.000-2856.000=-3.000
mean8.313-8.638=-0.325
σ0.628-0.308=0.320
min7.680-8.179=-0.500
max9.225-8.917=0.308
iters=5
new-facts=6402
prior-facts=6402
mean4945.235-4943.629=1.606
σ0.020-0.030=-0.009
min4945.213-4943.589=1.623
max4945.264-4943.666=1.598
mean3087.400-3058.000=29.400
σ298.900-212.159=86.741
min2853.000-2856.000=-3.000
max3544.000-3364.000=180.000
mean8.703-8.604=0.099
σ0.233-0.153=0.080
min8.541-8.384=0.157
max9.108-8.756=0.352

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.006-1.051=-0.045
σ0.123-0.128=-0.005
min0.920-0.924=-0.004
max1.201-1.241=-0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.845-473.080=-0.236
σ574.927-575.915=-0.987
min185.376-185.118=0.258
max1335.236-1336.952=-1.717
mean88.250
σ8.500
min84.000
max101.000
mean2853.000-2856.000=-3.000
σ0.000
min2853.000-2856.000=-3.000
max2853.000-2856.000=-3.000
mean0.486-0.484=0.002
σ0.372-0.377=-0.005
min0.298-0.291=0.006
max1.044-1.050=-0.006
policies=20
mean1854.021-1851.457=2.564
σ0.367-0.361=0.006
min1853.743-1851.198=2.545
max1854.555-1851.984=2.570
mean840.000
σ0.000
min840.000
max840.000
mean2853.000-2856.000=-3.000
σ0.000
min2853.000-2856.000=-3.000
max2853.000-2856.000=-3.000
mean2.950-2.962=-0.012
σ0.006-0.004=0.002
min2.943-2.958=-0.015
max2.958-2.967=-0.009
policies=200
mean18546.648-18521.142=25.505
σ0.565-0.456=0.109
min18546.324-18520.835=25.490
max18547.492-18521.820=25.672
mean8400.000
σ0.000
min8400.000
max8400.000
mean2853.000-2856.000=-3.000
σ0.000
min2853.000-2856.000=-3.000
max2853.000-2856.000=-3.000
mean29.193-29.351=-0.158
σ0.439-0.494=-0.055
min28.791-28.847=-0.056
max29.722-29.787=-0.065