Compare commits

Home / Compare be223800 .. 17d22dbd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean32.839-33.970=-1.131
σ0.370-0.053=0.317
min32.707-33.939=-1.232
max33.892-34.120=-0.228
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.085-0.081=0.004
σ0.004-0.004=-0.000
min0.077-0.076=0.002
max0.092-0.086=0.006
cache=y
dps=1
iters=10
policies=100
mean22.087-23.318=-1.230
σ0.003-0.003=-0.001
min22.082-23.312=-1.230
max22.091-23.323=-1.233
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.063=0.002
σ0.001-0.004=-0.003
min0.063-0.059=0.004
max0.067-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean983.408-998.459=-15.051
σ1.107-0.188=0.919
min982.886-998.182=-15.296
max988.051-998.760=-10.709
mean1050.900-1065.350=-14.450
σ304.547-313.733=-9.186
min631.000-619.000=12.000
max1515.000-1619.000=-104.000
mean1.398-1.425=-0.028
σ0.072-0.065=0.007
min1.332-1.319=0.012
max1.590-1.630=-0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean262.594-286.791=-24.197
σ0.008-0.002=0.006
min262.581-286.789=-24.207
max262.599-286.794=-24.194
mean1515.000-1619.000=-104.000
σ0.000
min1515.000-1619.000=-104.000
max1515.000-1619.000=-104.000
mean0.356-0.367=-0.011
σ0.008-0.001=0.007
min0.347-0.366=-0.019
max0.364-0.368=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1262.655-1286.879=-24.223
σ0.091-0.017=0.074
min1262.612-1286.857=-24.246
max1262.818-1286.899=-24.081
mean1515.000-1619.000=-104.000
σ0.000
min1515.000-1619.000=-104.000
max1515.000-1619.000=-104.000
mean1.906-1.884=0.022
σ0.099-0.109=-0.010
min1.789-1.818=-0.030
max2.020-2.076=-0.056
iters=5
new-facts=6402
prior-facts=1
mean2058.190-4110.247=-2052.057
σ7.023-7.415=-0.392
min2054.858-4106.917=-2052.059
max2070.742-4123.511=-2052.770
mean1515.000-1619.000=-104.000
σ0.000
min1515.000-1619.000=-104.000
max1515.000-1619.000=-104.000
mean4.545-7.293=-2.748
σ0.263-0.351=-0.088
min4.279-6.842=-2.562
max4.860-7.707=-2.847
iters=5
new-facts=6402
prior-facts=6402
mean2047.396-4100.135=-2052.740
σ0.006-0.033=-0.028
min2047.391-4100.110=-2052.719
max2047.405-4100.193=-2052.788
mean1821.000-1806.200=14.800
σ196.757-161.838=34.919
min1515.000-1619.000=-104.000
max1982.000-2034.000=-52.000
mean4.433-7.789=-3.355
σ0.035-0.350=-0.315
min4.401-7.290=-2.889
max4.481-8.224=-3.743

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.546-1.111=0.435
σ0.122-0.287=-0.164
min1.336-0.913=0.422
max1.642-1.614=0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.102-464.445=-27.343
σ572.824-574.786=-1.963
min150.683-177.040=-26.357
max1296.337-1326.625=-30.288
mean88.250
σ8.500
min84.000
max101.000
mean1515.000-1619.000=-104.000
σ0.000
min1515.000-1619.000=-104.000
max1515.000-1619.000=-104.000
mean0.533-0.552=-0.019
σ0.565-0.557=0.008
min0.249-0.272=-0.023
max1.381-1.388=-0.007
policies=20
mean1507.090-1770.739=-263.650
σ0.264-0.367=-0.103
min1506.898-1770.525=-263.627
max1507.479-1771.289=-263.810
mean840.000
σ0.000
min840.000
max840.000
mean1515.000-1619.000=-104.000
σ0.000
min1515.000-1619.000=-104.000
max1515.000-1619.000=-104.000
mean2.531-2.715=-0.184
σ0.034-0.019=0.015
min2.500-2.700=-0.200
max2.576-2.742=-0.166
policies=200
mean15078.648-17714.927=-2636.279
σ0.399-0.425=-0.025
min15078.383-17714.636=-2636.253
max15079.236-17715.555=-2636.318
mean8400.000
σ0.000
min8400.000
max8400.000
mean1515.000-1619.000=-104.000
σ0.000
min1515.000-1619.000=-104.000
max1515.000-1619.000=-104.000
mean25.451-27.383=-1.932
σ0.128-0.193=-0.065
min25.285-27.127=-1.843
max25.575-27.568=-1.993