Compare commits

Home / Compare 5c47e9d6 .. a262d139

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.566=0.001
σ0.044-0.045=-0.000
min70.543-70.539=0.004
max70.689-70.690=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.159=-0.001
σ0.003-0.005=-0.003
min0.155-0.153=0.002
max0.163-0.171=-0.008
cache=y
dps=1
iters=10
policies=100
mean21.288-21.289=-0.000
σ0.003-0.003=0.000
min21.284-21.285=-0.001
max21.292-21.294=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.062-0.065=-0.002
σ0.003-0.003=0.000
min0.058-0.063=-0.005
max0.068-0.073=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.570-1753.569=0.001
σ0.359-0.361=-0.002
min1753.000-1752.995=0.005
max1754.152-1754.173=-0.021
mean1645.100-1647.350=-2.250
σ634.841-634.830=0.011
min627.000
max2854.000-2860.000=-6.000
mean2.820-2.816=0.004
σ0.154-0.140=0.013
min2.364-2.411=-0.047
max3.083-3.019=0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.020-272.018=0.002
σ0.007-0.007=-0.000
min272.014-272.011=0.003
max272.032-272.029=0.003
mean2854.000-2860.000=-6.000
σ0.000
min2854.000-2860.000=-6.000
max2854.000-2860.000=-6.000
mean0.391-0.392=-0.001
σ0.011-0.010=0.001
min0.379-0.380=-0.002
max0.405-0.405=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.438-1932.434=0.004
σ0.007-0.013=-0.006
min1932.428-1932.416=0.012
max1932.446-1932.453=-0.007
mean2854.000-2860.000=-6.000
σ0.000
min2854.000-2860.000=-6.000
max2854.000-2860.000=-6.000
mean2.995-2.978=0.017
σ0.110-0.087=0.023
min2.817-2.846=-0.029
max3.121-3.080=0.040
iters=5
new-facts=6402
prior-facts=1
mean4753.194-4753.060=0.133
σ0.830-0.950=-0.120
min4752.787-4752.153=0.633
max4754.678-4754.674=0.003
mean2854.000-2860.000=-6.000
σ0.000
min2854.000-2860.000=-6.000
max2854.000-2860.000=-6.000
mean8.410-8.415=-0.005
σ0.199-0.523=-0.324
min8.177-7.612=0.565
max8.621-8.908=-0.287
iters=5
new-facts=6402
prior-facts=6402
mean4943.631-4943.633=-0.002
σ0.022-0.025=-0.002
min4943.601-4943.595=0.007
max4943.655-4943.657=-0.003
mean3052.200-3068.200=-16.000
σ252.024-222.209=29.816
min2854.000-2860.000=-6.000
max3428.000-3301.000=127.000
mean8.610-8.845=-0.235
σ0.342-0.468=-0.125
min8.376-8.424=-0.048
max9.205-9.574=-0.369

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.071-1.002=0.069
σ0.108-0.140=-0.033
min0.934-0.934=0.000
max1.236-1.253=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.081-473.083=-0.001
σ575.915-575.913=0.003
min185.112-185.116=-0.004
max1336.954-1336.952=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2854.000-2860.000=-6.000
σ0.000
min2854.000-2860.000=-6.000
max2854.000-2860.000=-6.000
mean0.452-0.424=0.028
σ0.304-0.263=0.041
min0.297-0.277=0.021
max0.908-0.819=0.090
policies=20
mean1851.465-1851.475=-0.011
σ0.378-0.372=0.006
min1851.181-1851.206=-0.025
max1852.014-1852.017=-0.003
mean840.000
σ0.000
min840.000
max840.000
mean2854.000-2860.000=-6.000
σ0.000
min2854.000-2860.000=-6.000
max2854.000-2860.000=-6.000
mean2.945-2.955=-0.009
σ0.001-0.014=-0.013
min2.944-2.940=0.003
max2.947-2.969=-0.022
policies=200
mean18521.127-18521.155=-0.028
σ0.530-0.345=0.186
min18520.586-18520.898=-0.312
max18521.854-18521.663=0.191
mean8400.000
σ0.000
min8400.000
max8400.000
mean2854.000-2860.000=-6.000
σ0.000
min2854.000-2860.000=-6.000
max2854.000-2860.000=-6.000
mean29.104-29.207=-0.103
σ0.450-0.374=0.076
min28.747-28.921=-0.174
max29.733-29.756=-0.023