Compare commits

Home / Compare 2ac0d4bb .. 2e77cc60

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.691-70.384=0.307
σ0.048-0.047=0.001
min70.658-70.356=0.302
max70.826-70.517=0.309
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.161-0.159=0.002
σ0.004-0.003=0.001
min0.158-0.155=0.003
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.420-21.142=0.278
σ0.003-0.002=0.001
min21.416-21.137=0.278
max21.425-21.146=0.279
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.064-0.064=-0.001
σ0.004-0.002=0.003
min0.058-0.063=-0.005
max0.074-0.069=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1752.394=2.064
σ0.360-0.360=0.000
min1753.881-1751.824=2.056
max1755.039-1752.975=2.064
mean1670.850-1654.400=16.450
σ628.866-627.581=1.285
min664.000-618.000=46.000
max2620.000-2769.000=-149.000
mean2.800-2.806=-0.005
σ0.126-0.190=-0.064
min2.412-2.322=0.090
max2.927-2.981=-0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.501-270.139=3.362
σ0.005-0.009=-0.004
min273.493-270.131=3.362
max273.506-270.154=3.352
mean2620.000-2769.000=-149.000
σ0.000
min2620.000-2769.000=-149.000
max2620.000-2769.000=-149.000
mean0.378-0.377=0.002
σ0.004-0.004=0.000
min0.376-0.371=0.005
max0.386-0.382=0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.892-1930.607=3.285
σ0.005-0.007=-0.002
min1933.883-1930.596=3.288
max1933.896-1930.615=3.281
mean2620.000-2769.000=-149.000
σ0.000
min2620.000-2769.000=-149.000
max2620.000-2769.000=-149.000
mean3.035-2.512=0.523
σ0.137-0.085=0.053
min2.820-2.431=0.390
max3.158-2.654=0.504
iters=5
new-facts=6402
prior-facts=1
mean4613.988-4751.332=-137.344
σ314.468-0.888=313.580
min4051.453-4750.819=-699.366
max4756.134-4752.914=3.220
mean2620.000-2769.000=-149.000
σ0.000
min2620.000-2769.000=-149.000
max2620.000-2769.000=-149.000
mean8.081-8.413=-0.332
σ0.725-0.465=0.260
min7.000-7.741=-0.742
max8.942-8.979=-0.038
iters=5
new-facts=6402
prior-facts=6402
mean4945.056-4941.699=3.357
σ0.173-0.144=0.029
min4944.747-4941.443=3.304
max4945.160-4941.790=3.370
mean3014.000-3044.400=-30.400
σ378.325-235.302=143.023
min2620.000-2769.000=-149.000
max3543.000-3371.000=172.000
mean8.815-8.680=0.136
σ0.366-0.208=0.158
min8.538-8.394=0.144
max9.448-8.925=0.523

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.286-1.019=0.266
σ0.358-0.117=0.241
min0.927-0.940=-0.012
max1.739-1.209=0.530

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.567-466.371=6.197
σ574.933-575.930=-0.997
min185.096-178.400=6.696
max1334.966-1330.266=4.701
mean88.250-84.250=4.000
σ8.500
min84.000-80.000=4.000
max101.000-97.000=4.000
mean2620.000-2769.000=-149.000
σ0.000
min2620.000-2769.000=-149.000
max2620.000-2769.000=-149.000
mean0.558-0.448=0.109
σ0.534-0.304=0.231
min0.289-0.293=-0.004
max1.359-0.904=0.455
policies=20
mean1851.234-1784.336=66.898
σ0.368-0.336=0.032
min1850.985-1784.101=66.884
max1851.780-1784.823=66.957
mean840.000-800.000=40.000
σ0.000
min840.000-800.000=40.000
max840.000-800.000=40.000
mean2620.000-2769.000=-149.000
σ0.000
min2620.000-2769.000=-149.000
max2620.000-2769.000=-149.000
mean2.859-2.847=0.012
σ0.021-0.128=-0.108
min2.836-2.780=0.056
max2.877-3.040=-0.163
policies=200
mean18519.214-17849.503=669.711
σ0.574-0.490=0.083
min18518.830-17849.216=669.614
max18520.056-17850.235=669.821
mean8400.000-8000.000=400.000
σ0.000
min8400.000-8000.000=400.000
max8400.000-8000.000=400.000
mean2620.000-2769.000=-149.000
σ0.000
min2620.000-2769.000=-149.000
max2620.000-2769.000=-149.000
mean28.955-28.008=0.947
σ0.032-0.113=-0.082
min28.925-27.882=1.043
max28.998-28.156=0.842