Compare commits

Home / Compare 8b216d93 .. 4def1b46

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.245=0.019
σ0.053-0.054=-0.000
min35.238-35.217=0.021
max35.415-35.396=0.019
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.086-0.086=-0.001
σ0.003-0.005=-0.001
min0.083-0.082=0.001
max0.091-0.096=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.001
σ0.002-0.002=0.000
min23.765-23.764=0.001
max23.774-23.772=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.068-0.068=0.001
σ0.003-0.003=0.000
min0.066-0.064=0.002
max0.076-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.483=0.002
σ0.365-0.365=-0.000
min1755.910-1755.910=0.000
max1757.070-1757.077=-0.007
mean1649.650-1659.600=-9.950
σ639.722-646.857=-7.135
min626.000-628.000=-2.000
max2826.000-2811.000=15.000
mean2.344-2.360=-0.015
σ0.080-0.105=-0.026
min2.206-2.255=-0.050
max2.565-2.713=-0.148

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.701-324.709=-0.008
σ0.058-0.039=0.019
min324.598-324.639=-0.041
max324.734-324.732=0.002
mean2826.000-2811.000=15.000
σ0.000
min2826.000-2811.000=15.000
max2826.000-2811.000=15.000
mean0.425-0.422=0.003
σ0.001-0.001=-0.000
min0.424-0.421=0.003
max0.426-0.423=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.256-1985.271=-0.016
σ0.015-0.007=0.008
min1985.241-1985.264=-0.022
max1985.276-1985.282=-0.006
mean2826.000-2811.000=15.000
σ0.000
min2826.000-2811.000=15.000
max2826.000-2811.000=15.000
mean2.622-2.615=0.007
σ0.069-0.074=-0.005
min2.546-2.552=-0.007
max2.711-2.702=0.009
iters=5
new-facts=6402
prior-facts=1
mean4808.867-4808.890=-0.023
σ7.657-7.653=0.004
min4805.394-4805.356=0.038
max4822.564-4822.579=-0.015
mean2826.000-2811.000=15.000
σ0.000
min2826.000-2811.000=15.000
max2826.000-2811.000=15.000
mean8.938-8.705=0.233
σ0.162-0.572=-0.409
min8.689-7.712=0.977
max9.084-9.098=-0.014
iters=5
new-facts=6402
prior-facts=6402
mean4996.469-4996.467=0.002
σ0.017-0.016=0.001
min4996.451-4996.450=0.002
max4996.491-4996.485=0.006
mean3047.200-3015.800=31.400
σ199.608-207.944=-8.336
min2826.000-2811.000=15.000
max3335.000-3301.000=34.000
mean8.720-8.667=0.052
σ0.254-0.104=0.150
min8.506-8.541=-0.035
max9.053-8.810=0.243

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-0.949=0.076
σ0.129-0.054=0.075
min0.909-0.916=-0.007
max1.224-1.042=0.181

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.968-462.966=0.002
σ574.253-574.249=0.004
min175.838-175.838=-0.001
max1324.347-1324.339=0.008
mean86.250
σ8.500
min82.000
max99.000
mean2826.000-2811.000=15.000
σ0.000
min2826.000-2811.000=15.000
max2826.000-2811.000=15.000
mean0.430-0.424=0.006
σ0.300-0.291=0.008
min0.276-0.275=0.001
max0.879-0.861=0.019
policies=20
mean1758.717-1758.716=0.001
σ0.349-0.345=0.004
min1758.478-1758.495=-0.017
max1759.234-1759.229=0.004
mean820.000
σ0.000
min820.000
max820.000
mean2826.000-2811.000=15.000
σ0.000
min2826.000-2811.000=15.000
max2826.000-2811.000=15.000
mean2.789-2.784=0.005
σ0.023-0.005=0.019
min2.772-2.779=-0.008
max2.822-2.789=0.033
policies=200
mean17593.291-17592.527=0.764
σ0.734-0.443=0.291
min17592.324-17592.170=0.155
max17593.902-17593.135=0.767
mean8200.000
σ0.000
min8200.000
max8200.000
mean2826.000-2811.000=15.000
σ0.000
min2826.000-2811.000=15.000
max2826.000-2811.000=15.000
mean27.873-27.502=0.371
σ0.416-0.206=0.210
min27.530-27.261=0.270
max28.382-27.764=0.618