Compare commits

Home / Compare 4c962aa3 .. 52f12be4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.001
σ0.053-0.054=-0.001
min35.238-35.238=0.001
max35.415-35.415=-0.001
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.086-0.085=0.001
σ0.003-0.003=-0.000
min0.083-0.082=0.001
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.000
σ0.002-0.003=-0.000
min23.765-23.765=0.000
max23.774-23.773=0.001
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.068-0.068=0.000
σ0.003-0.003=-0.000
min0.066-0.066=0.001
max0.076-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.485=0.001
σ0.365-0.365=-0.000
min1755.910-1755.911=-0.001
max1757.070-1757.076=-0.006
mean1649.650-1648.650=1.000
σ639.722-643.392=-3.670
min626.000-623.000=3.000
max2826.000-2841.000=-15.000
mean2.344-2.376=-0.031
σ0.080-0.139=-0.059
min2.206-2.263=-0.057
max2.565-2.853=-0.288

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.701-324.683=0.018
σ0.058-0.044=0.014
min324.598-324.604=-0.006
max324.734-324.710=0.024
mean2826.000-2841.000=-15.000
σ0.000
min2826.000-2841.000=-15.000
max2826.000-2841.000=-15.000
mean0.425-0.428=-0.003
σ0.001-0.009=-0.009
min0.424-0.422=0.002
max0.426-0.445=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1985.256-1985.265=-0.009
σ0.015-0.017=-0.002
min1985.241-1985.237=0.004
max1985.276-1985.282=-0.006
mean2826.000-2841.000=-15.000
σ0.000
min2826.000-2841.000=-15.000
max2826.000-2841.000=-15.000
mean2.622-2.650=-0.028
σ0.069-0.171=-0.102
min2.546-2.477=0.069
max2.711-2.862=-0.151
iters=5
new-facts=6402
prior-facts=1
mean4808.867-4808.892=-0.025
σ7.657-7.701=-0.044
min4805.394-4805.342=0.051
max4822.564-4822.667=-0.103
mean2826.000-2841.000=-15.000
σ0.000
min2826.000-2841.000=-15.000
max2826.000-2841.000=-15.000
mean8.938-8.978=-0.040
σ0.162-0.343=-0.181
min8.689-8.436=0.253
max9.084-9.321=-0.237
iters=5
new-facts=6402
prior-facts=6402
mean4996.469-4996.472=-0.003
σ0.017-0.021=-0.004
min4996.451-4996.452=-0.001
max4996.491-4996.496=-0.005
mean3047.200-3006.200=41.000
σ199.608-186.315=13.293
min2826.000-2841.000=-15.000
max3335.000-3295.000=40.000
mean8.720-8.648=0.072
σ0.254-0.133=0.121
min8.506-8.496=0.009
max9.053-8.797=0.256

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-0.994=0.031
σ0.129-0.188=-0.059
min0.909-0.905=0.004
max1.224-1.330=-0.106

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.968-462.976=-0.008
σ574.253-574.252=0.001
min175.838-175.836=0.002
max1324.347-1324.354=-0.007
mean86.250
σ8.500
min82.000
max99.000
mean2826.000-2841.000=-15.000
σ0.000
min2826.000-2841.000=-15.000
max2826.000-2841.000=-15.000
mean0.430-0.432=-0.002
σ0.300-0.302=-0.002
min0.276-0.277=-0.001
max0.879-0.885=-0.006
policies=20
mean1758.717-1758.718=-0.001
σ0.349-0.350=-0.001
min1758.478-1758.479=-0.000
max1759.234-1759.236=-0.003
mean820.000
σ0.000
min820.000
max820.000
mean2826.000-2841.000=-15.000
σ0.000
min2826.000-2841.000=-15.000
max2826.000-2841.000=-15.000
mean2.789-2.805=-0.017
σ0.023-0.024=-0.001
min2.772-2.782=-0.010
max2.822-2.830=-0.008
policies=200
mean17593.291-17593.314=-0.023
σ0.734-0.667=0.067
min17592.324-17592.519=-0.195
max17593.902-17593.922=-0.021
mean8200.000
σ0.000
min8200.000
max8200.000
mean2826.000-2841.000=-15.000
σ0.000
min2826.000-2841.000=-15.000
max2826.000-2841.000=-15.000
mean27.873-27.884=-0.011
σ0.416-0.331=0.085
min27.530-27.493=0.037
max28.382-28.223=0.159