Compare commits

Home / Compare 70d3685f .. 6929d1be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.620-35.617=0.002
σ0.053-0.053=0.000
min35.592-35.594=-0.001
max35.770-35.768=0.002
mean418.000-414.800=3.200
σ0.000-0.422=-0.422
min418.000-414.000=4.000
max418.000-415.000=3.000
mean0.085-0.083=0.002
σ0.003-0.006=-0.002
min0.082-0.077=0.005
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.048=-0.001
σ0.002-0.003=-0.000
min24.044-24.044=0.001
max24.051-24.053=-0.003
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.067-0.069=-0.002
σ0.005-0.003=0.001
min0.062-0.066=-0.004
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.490=0.001
σ0.365-0.364=0.001
min1755.916-1755.915=0.001
max1757.085-1757.074=0.011
mean1649.700-1649.100=0.600
σ640.261-642.844=-2.583
min635.000-650.000=-15.000
max2840.000-2833.000=7.000
mean2.339-2.326=0.012
σ0.092-0.071=0.021
min2.247-2.152=0.095
max2.613-2.427=0.186

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.768-324.769=-0.001
σ0.047-0.043=0.004
min324.687-324.694=-0.008
max324.810-324.807=0.003
mean2840.000-2833.000=7.000
σ0.000
min2840.000-2833.000=7.000
max2840.000-2833.000=7.000
mean0.427-0.425=0.002
σ0.005-0.001=0.005
min0.421-0.423=-0.002
max0.436-0.425=0.011
iters=5
new-facts=1
prior-facts=6402
mean1844.989-1985.325=-140.336
σ313.767-0.013=313.754
min1283.705-1985.306=-701.601
max1985.327-1985.342=-0.016
mean2840.000-2833.000=7.000
σ0.000
min2840.000-2833.000=7.000
max2840.000-2833.000=7.000
mean2.473-2.675=-0.202
σ0.434-0.189=0.245
min1.747-2.563=-0.816
max2.921-3.007=-0.086
iters=5
new-facts=6402
prior-facts=1
mean4808.977-4809.001=-0.024
σ7.480-7.758=-0.278
min4805.612-4804.971=0.641
max4822.358-4822.867=-0.509
mean2840.000-2833.000=7.000
σ0.000
min2840.000-2833.000=7.000
max2840.000-2833.000=7.000
mean9.020-8.719=0.301
σ0.136-0.555=-0.419
min8.930-7.737=1.193
max9.257-9.060=0.197
iters=5
new-facts=6402
prior-facts=6402
mean4996.555-4996.544=0.011
σ0.169-0.157=0.012
min4996.255-4996.266=-0.011
max4996.650-4996.642=0.009
mean2988.600-3063.000=-74.400
σ231.624-303.680=-72.056
min2840.000-2833.000=7.000
max3368.000-3534.000=-166.000
mean8.435-8.526=-0.092
σ0.090-0.143=-0.053
min8.285-8.435=-0.150
max8.523-8.778=-0.255

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.970-0.977=-0.008
σ0.072-0.068=0.004
min0.911-0.922=-0.011
max1.050-1.059=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.216-463.213=0.003
σ574.772-574.772=-0.001
min175.824-175.817=0.007
max1325.374-1325.371=0.003
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2833.000=7.000
σ0.000
min2840.000-2833.000=7.000
max2840.000-2833.000=7.000
mean0.434-0.430=0.004
σ0.302-0.297=0.005
min0.277-0.279=-0.001
max0.887-0.876=0.011
policies=20
mean1758.537-1758.495=0.042
σ0.361-0.356=0.005
min1758.292-1758.257=0.035
max1759.071-1759.022=0.049
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2833.000=7.000
σ0.000
min2840.000-2833.000=7.000
max2840.000-2833.000=7.000
mean2.785-2.789=-0.004
σ0.026-0.017=0.009
min2.765-2.770=-0.005
max2.824-2.808=0.015
policies=200
mean17592.002-17592.076=-0.074
σ0.480-0.525=-0.045
min17591.472-17591.807=-0.335
max17592.615-17592.864=-0.249
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2833.000=7.000
σ0.000
min2840.000-2833.000=7.000
max2840.000-2833.000=7.000
mean27.790-27.930=-0.140
σ0.420-0.368=0.052
min27.391-27.541=-0.149
max28.252-28.328=-0.076