Compare commits

Home / Compare a03dd81c .. 0a49d580

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.568=-0.005
σ0.049-0.045=0.005
min70.534-70.544=-0.010
max70.701-70.691=0.009
mean413.400-418.600=-5.200
σ0.516
min413.000-418.000=-5.000
max414.000-419.000=-5.000
mean0.159-0.159=0.000
σ0.003-0.003=0.000
min0.155-0.154=0.001
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.001
σ0.004-0.003=0.001
min21.281-21.282=-0.001
max21.293-21.292=0.002
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.062-0.064=-0.002
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.070-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1753.372=0.000
σ0.361-0.359=0.002
min1752.802-1752.809=-0.007
max1753.951-1753.939=0.012
mean1660.650-1655.100=5.550
σ636.773-634.377=2.396
min686.000-638.000=48.000
max2768.000-2854.000=-86.000
mean2.761-2.795=-0.034
σ0.184-0.111=0.073
min2.128-2.518=-0.390
max2.952-3.011=-0.059

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.753-271.754=-0.001
σ0.007-0.002=0.005
min271.742-271.752=-0.011
max271.759-271.758=0.001
mean2768.000-2854.000=-86.000
σ0.000
min2768.000-2854.000=-86.000
max2768.000-2854.000=-86.000
mean0.379-0.383=-0.004
σ0.004-0.007=-0.003
min0.375-0.376=-0.000
max0.385-0.394=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.181-1932.182=-0.002
σ0.009-0.007=0.001
min1932.173-1932.175=-0.001
max1932.193-1932.191=0.002
mean2768.000-2854.000=-86.000
σ0.000
min2768.000-2854.000=-86.000
max2768.000-2854.000=-86.000
mean3.045-2.942=0.103
σ0.228-0.152=0.076
min2.738-2.786=-0.048
max3.361-3.147=0.214
iters=5
new-facts=6402
prior-facts=1
mean4752.907-4752.875=0.032
σ0.841-0.890=-0.049
min4752.430-4752.107=0.323
max4754.400-4754.415=-0.014
mean2768.000-2854.000=-86.000
σ0.000
min2768.000-2854.000=-86.000
max2768.000-2854.000=-86.000
mean8.463-7.935=0.528
σ0.506-0.310=0.196
min7.655-7.710=-0.055
max8.906-8.481=0.425
iters=5
new-facts=6402
prior-facts=6402
mean4943.310-4943.157=0.153
σ0.147-0.324=-0.177
min4943.049-4942.638=0.411
max4943.394-4943.390=0.003
mean3052.200-3073.000=-20.800
σ250.361-295.946=-45.585
min2768.000-2854.000=-86.000
max3403.000-3532.000=-129.000
mean8.643-8.426=0.217
σ0.167-0.087=0.079
min8.487-8.345=0.142
max8.872-8.565=0.307

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.077-0.997=0.080
σ0.113-0.123=-0.010
min0.933-0.937=-0.004
max1.250-1.216=0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.860-472.854=0.006
σ575.926-575.912=0.014
min184.888-184.892=-0.004
max1336.749-1336.723=0.027
mean88.250
σ8.500
min84.000
max101.000
mean2768.000-2854.000=-86.000
σ0.000
min2768.000-2854.000=-86.000
max2768.000-2854.000=-86.000
mean0.483-0.450=0.033
σ0.371-0.308=0.063
min0.292-0.293=-0.002
max1.039-0.912=0.128
policies=20
mean1849.181-1849.190=-0.009
σ0.336-0.371=-0.035
min1848.912-1848.916=-0.004
max1849.669-1849.729=-0.060
mean840.000
σ0.000
min840.000
max840.000
mean2768.000-2854.000=-86.000
σ0.000
min2768.000-2854.000=-86.000
max2768.000-2854.000=-86.000
mean2.923-2.951=-0.028
σ0.081-0.015=0.066
min2.861-2.938=-0.077
max3.042-2.969=0.073
policies=200
mean18498.680-18498.629=0.051
σ0.544-0.512=0.032
min18498.259-18498.326=-0.067
max18499.475-18499.394=0.081
mean8400.000
σ0.000
min8400.000
max8400.000
mean2768.000-2854.000=-86.000
σ0.000
min2768.000-2854.000=-86.000
max2768.000-2854.000=-86.000
mean28.888-29.241=-0.354
σ0.044-0.618=-0.574
min28.853-28.692=0.161
max28.951-29.868=-0.917