Compare commits

Home / Compare 1002caae .. a12689bc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.245=-0.000
σ0.055-0.053=0.001
min35.219-35.220=-0.001
max35.399-35.395=0.003
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.086-0.086=0.001
σ0.004-0.004=0.001
min0.082-0.082=-0.000
max0.094-0.093=0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=0.000
σ0.003-0.004=-0.001
min23.765-23.764=0.001
max23.774-23.779=-0.005
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.068-0.068=-0.000
σ0.003-0.004=-0.001
min0.066-0.065=0.001
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.365=-0.002
σ0.366-0.364=0.002
min1755.787-1755.791=-0.004
max1756.953-1756.951=0.003
mean1650.450-1628.200=22.250
σ641.089-594.633=46.457
min652.000-651.000=1.000
max2832.000-2431.000=401.000
mean2.353-2.314=0.039
σ0.098-0.067=0.031
min2.269-2.235=0.034
max2.652-2.458=0.194

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.588-324.584=0.004
σ0.046-0.043=0.002
min324.507-324.507=0.001
max324.618-324.607=0.011
mean2832.000-2431.000=401.000
σ0.000
min2832.000-2431.000=401.000
max2832.000-2431.000=401.000
mean0.424-0.423=0.001
σ0.002-0.001=0.001
min0.422-0.421=0.001
max0.427-0.424=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.134-1985.138=-0.003
σ0.014-0.016=-0.002
min1985.117-1985.110=0.007
max1985.149-1985.152=-0.003
mean2832.000-2431.000=401.000
σ0.000
min2832.000-2431.000=401.000
max2832.000-2431.000=401.000
mean2.597-2.831=-0.234
σ0.072-0.269=-0.196
min2.530-2.547=-0.017
max2.677-3.150=-0.472
iters=5
new-facts=6402
prior-facts=1
mean4808.757-4808.624=0.133
σ7.666-7.396=0.269
min4805.215-4805.264=-0.049
max4822.469-4821.855=0.614
mean2832.000-2431.000=401.000
σ0.000
min2832.000-2431.000=401.000
max2832.000-2431.000=401.000
mean9.001-8.904=0.097
σ0.304-0.217=0.088
min8.701-8.595=0.107
max9.507-9.180=0.327
iters=5
new-facts=6402
prior-facts=6402
mean4996.345-4996.350=-0.005
σ0.024-0.022=0.002
min4996.323-4996.325=-0.002
max4996.378-4996.374=0.004
mean3071.000-3013.000=58.000
σ227.190-413.898=-186.707
min2832.000-2459.000=373.000
max3400.000-3532.000=-132.000
mean8.830-8.790=0.040
σ0.321-0.170=0.152
min8.541-8.602=-0.062
max9.311-9.039=0.272

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-1.711=-0.730
σ0.068-0.094=-0.026
min0.922-1.570=-0.648
max1.058-1.802=-0.743

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.942=0.030
σ574.255-574.245=0.010
min175.835-175.814=0.021
max1324.355-1324.311=0.045
mean86.250
σ8.500
min82.000
max99.000
mean2832.000-2431.000=401.000
σ0.000
min2832.000-2431.000=401.000
max2832.000-2431.000=401.000
mean0.430-0.560=-0.131
σ0.300-0.576=-0.276
min0.277-0.270=0.007
max0.880-1.425=-0.545
policies=20
mean1758.716-1758.482=0.233
σ0.354-0.340=0.014
min1758.482-1758.252=0.230
max1759.241-1758.985=0.256
mean820.000
σ0.000
min820.000
max820.000
mean2832.000-2431.000=401.000
σ0.000
min2832.000-2431.000=401.000
max2832.000-2431.000=401.000
mean2.781-2.712=0.070
σ0.006-0.005=0.001
min2.776-2.705=0.071
max2.788-2.716=0.072
policies=200
mean17593.318-17592.197=1.121
σ0.649-0.427=0.222
min17592.480-17591.873=0.606
max17593.870-17592.824=1.046
mean8200.000
σ0.000
min8200.000
max8200.000
mean2832.000-2431.000=401.000
σ0.000
min2832.000-2431.000=401.000
max2832.000-2431.000=401.000
mean27.791-27.391=0.400
σ0.366-0.095=0.271
min27.441-27.253=0.187
max28.162-27.469=0.692