Compare commits

Home / Compare 4a71567a .. 5539e44c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-35.618=18.295
σ0.366-0.054=0.312
min53.787-35.591=18.196
max54.955-35.770=19.185
mean416.000-414.700=1.300
σ0.000-0.483=-0.483
min416.000-414.000=2.000
max416.000-415.000=1.000
mean0.139-0.086=0.053
σ0.004-0.004=-0.000
min0.135-0.082=0.054
max0.146-0.093=0.053
cache=y
dps=1
iters=10
policies=100
mean43.141-24.047=19.093
σ0.007-0.002=0.005
min43.129-24.043=19.086
max43.151-24.051=19.100
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.070=0.051
σ0.003-0.003=0.001
min0.117-0.067=0.050
max0.128-0.075=0.053

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.081-1756.489=-764.408
σ1.232-0.365=0.867
min991.493-1755.914=-764.421
max997.252-1757.080=-759.828
mean1062.700-1649.750=-587.050
σ312.070-641.589=-329.519
min605.000-633.000=-28.000
max1598.000-2830.000=-1232.000
mean1.539-2.342=-0.804
σ0.096-0.072=0.024
min1.409-2.261=-0.852
max1.816-2.512=-0.696

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.665-324.775=-39.110
σ0.021-0.033=-0.012
min285.632-324.718=-39.086
max285.685-324.794=-39.110
mean1598.000-2830.000=-1232.000
σ0.000
min1598.000-2830.000=-1232.000
max1598.000-2830.000=-1232.000
mean0.375-0.428=-0.053
σ0.001-0.010=-0.009
min0.374-0.420=-0.046
max0.376-0.440=-0.064
iters=5
new-facts=1
prior-facts=6402
mean1285.633-1985.329=-699.696
σ0.123-0.012=0.111
min1285.575-1985.308=-699.733
max1285.853-1985.342=-699.488
mean1598.000-2830.000=-1232.000
σ0.000
min1598.000-2830.000=-1232.000
max1598.000-2830.000=-1232.000
mean1.882-2.613=-0.731
σ0.059-0.104=-0.045
min1.808-2.487=-0.680
max1.956-2.753=-0.796
iters=5
new-facts=6402
prior-facts=1
mean1807.994-4809.112=-3001.118
σ6.998-7.658=-0.660
min1804.649-4805.610=-3000.961
max1820.499-4822.811=-3002.312
mean1598.000-2830.000=-1232.000
σ0.000
min1598.000-2830.000=-1232.000
max1598.000-2830.000=-1232.000
mean4.269-8.796=-4.526
σ0.171-0.528=-0.357
min4.078-8.077=-3.999
max4.481-9.522=-5.042
iters=5
new-facts=6402
prior-facts=6402
mean2070.467-4996.626=-2926.159
σ0.011-0.031=-0.020
min2070.459-4996.591=-2926.133
max2070.485-4996.663=-2926.177
mean1851.800-3071.800=-1220.000
σ209.992-313.606=-103.614
min1598.000-2830.000=-1232.000
max2087.000-3551.000=-1464.000
mean4.541-8.678=-4.137
σ0.107-0.466=-0.359
min4.416-8.417=-4.001
max4.687-9.501=-4.814

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.318-1.064=0.253
σ0.303-0.189=0.114
min0.985-0.912=0.074
max1.677-1.386=0.292

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.378-463.213=-25.835
σ572.364-574.771=-2.407
min151.194-175.818=-24.623
max1295.924-1325.370=-29.446
mean90.250-86.250=4.000
σ8.500
min86.000-82.000=4.000
max103.000-99.000=4.000
mean1598.000-2830.000=-1232.000
σ0.000
min1598.000-2830.000=-1232.000
max1598.000-2830.000=-1232.000
mean0.520-0.429=0.091
σ0.533-0.295=0.238
min0.250-0.278=-0.029
max1.320-0.871=0.449
policies=20
mean1512.173-1758.525=-246.352
σ0.200-0.357=-0.157
min1512.026-1758.293=-246.267
max1512.468-1759.055=-246.587
mean860.000-820.000=40.000
σ0.000
min860.000-820.000=40.000
max860.000-820.000=40.000
mean1598.000-2830.000=-1232.000
σ0.000
min1598.000-2830.000=-1232.000
max1598.000-2830.000=-1232.000
mean2.519-2.772=-0.253
σ0.023-0.018=0.005
min2.494-2.746=-0.252
max2.539-2.783=-0.245
policies=200
mean15129.511-17592.184=-2462.673
σ0.414-0.429=-0.014
min15128.898-17591.875=-2462.977
max15129.788-17592.816=-2463.028
mean8600.000-8200.000=400.000
σ0.000
min8600.000-8200.000=400.000
max8600.000-8200.000=400.000
mean1598.000-2830.000=-1232.000
σ0.000
min1598.000-2830.000=-1232.000
max1598.000-2830.000=-1232.000
mean25.592-27.829=-2.237
σ0.116-0.380=-0.264
min25.474-27.473=-1.999
max25.740-28.232=-2.492