Compare commits

Home / Compare a93afbba .. e9ab9bfb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.001
σ0.046-0.048=-0.002
min70.749-70.747=0.002
max70.909-70.915=-0.005
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.158-0.160=-0.002
σ0.005-0.003=0.002
min0.151-0.157=-0.006
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.002-0.004=-0.001
min21.489-21.489=-0.000
max21.496-21.500=-0.004
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.066-0.065=0.001
σ0.003-0.003=0.001
min0.063-0.064=-0.000
max0.074-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.093=0.002
σ0.360-0.360=0.000
min1753.530-1753.528=0.001
max1754.683-1754.680=0.003
mean1660.750-1659.500=1.250
σ630.614-617.064=13.550
min632.000-645.000=-13.000
max2700.000-2492.000=208.000
mean2.854-2.792=0.062
σ0.209-0.221=-0.012
min2.117-2.267=-0.151
max3.158-3.164=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.954-271.956=-0.002
σ0.008-0.007=0.001
min271.946-271.949=-0.003
max271.961-271.967=-0.006
mean2700.000-2492.000=208.000
σ0.000
min2700.000-2492.000=208.000
max2700.000-2492.000=208.000
mean0.385-0.384=0.001
σ0.008-0.011=-0.003
min0.380-0.378=0.002
max0.398-0.403=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.337-1932.315=0.022
σ0.013-0.011=0.002
min1932.322-1932.298=0.024
max1932.356-1932.326=0.030
mean2700.000-2492.000=208.000
σ0.000
min2700.000-2492.000=208.000
max2700.000-2492.000=208.000
mean2.994-3.039=-0.045
σ0.187-0.114=0.074
min2.671-2.927=-0.256
max3.149-3.231=-0.082
iters=5
new-facts=6402
prior-facts=1
mean4752.969-4753.055=-0.086
σ0.975-0.910=0.064
min4752.186-4752.577=-0.391
max4754.660-4754.681=-0.020
mean2700.000-2492.000=208.000
σ0.000
min2700.000-2492.000=208.000
max2700.000-2492.000=208.000
mean8.669-8.700=-0.031
σ0.502-0.515=-0.013
min8.164-7.864=0.299
max9.290-9.182=0.108
iters=5
new-facts=6402
prior-facts=6402
mean4943.560-4943.558=0.002
σ0.023-0.015=0.008
min4943.534-4943.540=-0.006
max4943.595-4943.572=0.023
mean3032.600-2958.000=74.600
σ343.955-272.310=71.645
min2700.000-2590.000=110.000
max3513.000-3311.000=202.000
mean8.622-8.578=0.044
σ0.326-0.198=0.129
min8.381-8.462=-0.081
max9.181-8.931=0.250

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.029-1.703=-0.674
σ0.141-0.192=-0.051
min0.930-1.455=-0.525
max1.256-1.920=-0.664

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.619-468.611=0.008
σ574.895-574.882=0.014
min181.164-181.166=-0.002
max1330.961-1330.933=0.028
mean88.250
σ8.500
min84.000
max101.000
mean2700.000-2492.000=208.000
σ0.000
min2700.000-2492.000=208.000
max2700.000-2492.000=208.000
mean0.571-0.571=-0.000
σ0.559-0.556=0.004
min0.289-0.292=-0.002
max1.410-1.404=0.006
policies=20
mean1811.954-1811.957=-0.003
σ0.370-0.388=-0.018
min1811.700-1811.700=0.000
max1812.500-1812.530=-0.030
mean840.000
σ0.000
min840.000
max840.000
mean2700.000-2492.000=208.000
σ0.000
min2700.000-2492.000=208.000
max2700.000-2492.000=208.000
mean2.822-2.832=-0.010
σ0.015-0.027=-0.012
min2.809-2.800=0.009
max2.844-2.865=-0.022
policies=200
mean18126.711-18126.781=-0.070
σ0.349-0.486=-0.137
min18126.514-18126.487=0.027
max18127.234-18127.508=-0.274
mean8400.000
σ0.000
min8400.000
max8400.000
mean2700.000-2492.000=208.000
σ0.000
min2700.000-2492.000=208.000
max2700.000-2492.000=208.000
mean28.491-28.584=-0.093
σ0.080-0.073=0.008
min28.399-28.498=-0.098
max28.594-28.663=-0.069