Compare commits

Home / Compare b0a6bcf8 .. 57f52af6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.034-70.706=2.328
σ0.047-0.047=0.001
min73.008-70.672=2.336
max73.167-70.836=2.332
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.158-0.158=-0.001
σ0.005-0.006=-0.001
min0.149-0.150=-0.001
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.732-21.412=2.320
σ0.003-0.003=0.000
min23.727-21.407=2.320
max23.738-21.417=2.320
mean416.000-417.900=-1.900
σ0.000-0.316=-0.316
min416.000-417.000=-1.000
max416.000-418.000=-2.000
mean0.065-0.065=0.000
σ0.002-0.002=0.000
min0.064-0.064=0.001
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1754.929=3.857
σ0.362-0.358=0.004
min1758.211-1754.364=3.847
max1759.372-1755.502=3.870
mean1654.650-1649.250=5.400
σ635.029-631.656=3.373
min620.000-628.000=-8.000
max2780.000-2773.000=7.000
mean2.823-2.804=0.020
σ0.097-0.194=-0.097
min2.575-2.371=0.204
max2.971-3.191=-0.220

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.009-272.794=51.215
σ0.056-0.006=0.050
min323.909-272.783=51.126
max324.038-272.797=51.240
mean2780.000-2773.000=7.000
σ0.000
min2780.000-2773.000=7.000
max2780.000-2773.000=7.000
mean0.427-0.381=0.046
σ0.006-0.009=-0.003
min0.423-0.373=0.050
max0.437-0.394=0.042
iters=5
new-facts=1
prior-facts=6402
mean1984.593-1933.229=51.364
σ0.011-0.009=0.002
min1984.579-1933.218=51.361
max1984.603-1933.241=51.362
mean2780.000-2773.000=7.000
σ0.000
min2780.000-2773.000=7.000
max2780.000-2773.000=7.000
mean2.668-2.883=-0.215
σ0.105-0.276=-0.170
min2.557-2.416=0.141
max2.794-3.067=-0.273
iters=5
new-facts=6402
prior-facts=1
mean4808.266-4757.008=51.258
σ7.755-7.569=0.186
min4804.680-4753.543=51.136
max4822.136-4770.547=51.589
mean2780.000-2773.000=7.000
σ0.000
min2780.000-2773.000=7.000
max2780.000-2773.000=7.000
mean8.642-8.159=0.483
σ0.528-0.477=0.051
min7.715-7.674=0.041
max8.973-8.772=0.200
iters=5
new-facts=6402
prior-facts=6402
mean4995.802-4944.451=51.351
σ0.026-0.022=0.004
min4995.763-4944.428=51.335
max4995.836-4944.484=51.352
mean3026.000-3017.600=8.400
σ287.281-285.499=1.782
min2780.000-2773.000=7.000
max3435.000-3428.000=7.000
mean8.506-8.497=0.009
σ0.087-0.109=-0.023
min8.435-8.357=0.078
max8.655-8.652=0.003

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.035=-0.035
σ0.138-0.124=0.014
min0.899-0.915=-0.017
max1.219-1.221=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.346-468.324=0.022
σ574.232-574.227=0.005
min181.225-181.200=0.025
max1329.694-1329.664=0.030
mean88.250
σ8.500
min84.000
max101.000
mean2780.000-2773.000=7.000
σ0.000
min2780.000-2773.000=7.000
max2780.000-2773.000=7.000
mean0.436-0.443=-0.008
σ0.285-0.304=-0.019
min0.287-0.288=-0.001
max0.862-0.899=-0.037
policies=20
mean1812.620-1812.338=0.282
σ0.391-0.390=0.001
min1812.343-1812.058=0.285
max1813.193-1812.909=0.284
mean840.000
σ0.000
min840.000
max840.000
mean2780.000-2773.000=7.000
σ0.000
min2780.000-2773.000=7.000
max2780.000-2773.000=7.000
mean2.894-2.884=0.010
σ0.041-0.026=0.015
min2.860-2.865=-0.006
max2.953-2.922=0.031
policies=200
mean18131.500-18128.991=2.509
σ0.344-0.483=-0.138
min18131.187-18128.681=2.506
max18131.944-18129.710=2.234
mean8400.000
σ0.000
min8400.000
max8400.000
mean2780.000-2773.000=7.000
σ0.000
min2780.000-2773.000=7.000
max2780.000-2773.000=7.000
mean28.348-28.322=0.026
σ0.293-0.171=0.122
min28.146-28.223=-0.077
max28.783-28.578=0.205