Compare commits

Home / Compare 8f5c1df1 .. f8e48a63

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.691-70.678=0.013
σ0.048-0.046=0.003
min70.658-70.656=0.003
max70.826-70.807=0.019
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.161-0.159=0.001
σ0.004-0.006=-0.002
min0.158-0.152=0.006
max0.168-0.169=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.420-21.418=0.002
σ0.003-0.003=-0.000
min21.416-21.412=0.004
max21.425-21.421=0.004
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.064-0.063=0.001
σ0.004-0.003=0.001
min0.058-0.059=-0.001
max0.074-0.069=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.457=0.001
σ0.360-0.362=-0.001
min1753.881-1753.879=0.001
max1755.039-1755.038=0.000
mean1670.850-1641.200=29.650
σ628.866-634.859=-5.993
min664.000-636.000=28.000
max2620.000-2850.000=-230.000
mean2.800-2.837=-0.037
σ0.126-0.120=0.006
min2.412-2.564=-0.152
max2.927-3.069=-0.142

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.501-273.505=-0.005
σ0.005-0.005=0.000
min273.493-273.498=-0.005
max273.506-273.512=-0.007
mean2620.000-2850.000=-230.000
σ0.000
min2620.000-2850.000=-230.000
max2620.000-2850.000=-230.000
mean0.378-0.385=-0.006
σ0.004-0.004=-0.000
min0.376-0.382=-0.006
max0.386-0.392=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.892-1933.889=0.003
σ0.005-0.009=-0.004
min1933.883-1933.876=0.007
max1933.896-1933.900=-0.003
mean2620.000-2850.000=-230.000
σ0.000
min2620.000-2850.000=-230.000
max2620.000-2850.000=-230.000
mean3.035-3.034=0.001
σ0.137-0.065=0.072
min2.820-2.954=-0.134
max3.158-3.114=0.044
iters=5
new-facts=6402
prior-facts=1
mean4613.988-4754.628=-140.640
σ314.468-0.832=313.636
min4051.453-4754.153=-702.700
max4756.134-4756.105=0.029
mean2620.000-2850.000=-230.000
σ0.000
min2620.000-2850.000=-230.000
max2620.000-2850.000=-230.000
mean8.081-8.690=-0.609
σ0.725-0.331=0.394
min7.000-8.227=-1.228
max8.942-9.086=-0.145
iters=5
new-facts=6402
prior-facts=6402
mean4945.056-4945.116=-0.060
σ0.173-0.023=0.150
min4944.747-4945.089=-0.342
max4945.160-4945.142=0.018
mean3014.000-3047.400=-33.400
σ378.325-205.703=172.621
min2620.000-2850.000=-230.000
max3543.000-3341.000=202.000
mean8.815-8.667=0.148
σ0.366-0.212=0.155
min8.538-8.439=0.099
max9.448-8.872=0.576

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.286-1.050=0.235
σ0.358-0.131=0.228
min0.927-0.931=-0.004
max1.739-1.253=0.486

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.567-472.571=-0.003
σ574.933-574.924=0.008
min185.096-185.101=-0.005
max1334.966-1334.957=0.009
mean88.250
σ8.500
min84.000
max101.000
mean2620.000-2850.000=-230.000
σ0.000
min2620.000-2850.000=-230.000
max2620.000-2850.000=-230.000
mean0.558-0.452=0.106
σ0.534-0.303=0.231
min0.289-0.295=-0.006
max1.359-0.907=0.452
policies=20
mean1851.234-1851.301=-0.067
σ0.368-0.371=-0.003
min1850.985-1851.033=-0.047
max1851.780-1851.842=-0.062
mean840.000
σ0.000
min840.000
max840.000
mean2620.000-2850.000=-230.000
σ0.000
min2620.000-2850.000=-230.000
max2620.000-2850.000=-230.000
mean2.859-2.953=-0.094
σ0.021-0.009=0.011
min2.836-2.943=-0.107
max2.877-2.963=-0.087
policies=200
mean18519.214-18519.507=-0.293
σ0.574-0.430=0.144
min18518.830-18519.180=-0.350
max18520.056-18520.138=-0.082
mean8400.000
σ0.000
min8400.000
max8400.000
mean2620.000-2850.000=-230.000
σ0.000
min2620.000-2850.000=-230.000
max2620.000-2850.000=-230.000
mean28.955-29.205=-0.250
σ0.032-0.405=-0.373
min28.925-28.914=0.011
max28.998-29.803=-0.805