Compare commits

Home / Compare 3e179f07 .. d44e59bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.000
σ0.047-0.048=-0.001
min33.953-33.951=0.002
max34.108-34.111=-0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.084-0.083=0.002
σ0.003-0.005=-0.002
min0.081-0.077=0.004
max0.090-0.095=-0.005
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.001
σ0.002-0.002=0.000
min23.313-23.313=-0.000
max23.322-23.319=0.002
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.066-0.061=0.005
σ0.003-0.004=-0.001
min0.064-0.059=0.005
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1719.428-1757.365=-37.937
σ169.711-0.364=169.347
min998.406-1756.786=-758.381
max1757.954-1757.950=0.004
mean1624.700-1665.500=-40.800
σ604.328-627.569=-23.241
min671.000-670.000=1.000
max2611.000-2613.000=-2.000
mean2.306-2.340=-0.034
σ0.240-0.109=0.131
min1.379-2.238=-0.859
max2.670-2.648=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.507-326.522=-0.016
σ0.048-0.013=0.035
min326.421-326.502=-0.081
max326.534-326.534=0.000
mean2611.000-2613.000=-2.000
σ0.000
min2611.000-2613.000=-2.000
max2611.000-2613.000=-2.000
mean0.425-0.421=0.004
σ0.005-0.001=0.003
min0.421-0.419=0.001
max0.433-0.423=0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.674-1988.681=-0.007
σ0.012-0.013=-0.001
min1988.654-1988.668=-0.014
max1988.684-1988.697=-0.013
mean2611.000-2613.000=-2.000
σ0.000
min2611.000-2613.000=-2.000
max2611.000-2613.000=-2.000
mean2.756-2.673=0.083
σ0.182-0.084=0.098
min2.626-2.560=0.065
max3.078-2.773=0.305
iters=5
new-facts=6402
prior-facts=1
mean4813.439-4813.415=0.025
σ7.820-7.817=0.003
min4809.600-4809.489=0.111
max4827.423-4827.391=0.032
mean2611.000-2613.000=-2.000
σ0.000
min2611.000-2613.000=-2.000
max2611.000-2613.000=-2.000
mean8.507-8.875=-0.368
σ0.690-0.511=0.179
min7.824-8.409=-0.586
max9.581-9.623=-0.041
iters=5
new-facts=6402
prior-facts=6402
mean5000.856-5001.073=-0.217
σ0.305-0.027=0.279
min5000.392-5001.043=-0.651
max5001.073-5001.106=-0.033
mean2949.600-3018.800=-69.200
σ354.817-291.726=63.090
min2611.000-2613.000=-2.000
max3418.000-3394.000=24.000
mean9.529-9.660=-0.131
σ0.403-0.287=0.117
min8.821-9.198=-0.377
max9.779-9.924=-0.146

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.136-1.203=-0.067
σ0.272-0.357=-0.085
min0.917-0.905=0.012
max1.572-1.781=-0.209

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.505-464.505=0.000
σ574.778-574.779=-0.001
min177.108-177.109=-0.001
max1326.672-1326.673=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2611.000-2613.000=-2.000
σ0.000
min2611.000-2613.000=-2.000
max2611.000-2613.000=-2.000
mean0.526-0.559=-0.033
σ0.507-0.569=-0.063
min0.271-0.273=-0.002
max1.286-1.413=-0.128
policies=20
mean1771.384-1771.375=0.009
σ0.356-0.355=0.000
min1771.149-1771.139=0.011
max1771.912-1771.903=0.009
mean840.000
σ0.000
min840.000
max840.000
mean2611.000-2613.000=-2.000
σ0.000
min2611.000-2613.000=-2.000
max2611.000-2613.000=-2.000
mean2.722-2.717=0.005
σ0.014-0.027=-0.013
min2.705-2.692=0.013
max2.737-2.754=-0.018
policies=200
mean17721.134-17721.000=0.134
σ0.471-0.424=0.047
min17720.880-17720.671=0.208
max17721.840-17721.621=0.220
mean8400.000
σ0.000
min8400.000
max8400.000
mean2611.000-2613.000=-2.000
σ0.000
min2611.000-2613.000=-2.000
max2611.000-2613.000=-2.000
mean27.530-27.461=0.069
σ0.071-0.087=-0.016
min27.435-27.382=0.053
max27.599-27.573=0.026