Compare commits

Home / Compare b432ebec .. f22c3b6e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-70.701=-35.084
σ0.053-0.045=0.008
min35.589-70.673=-35.084
max35.767-70.826=-35.059
mean415.600-414.000=1.600
σ0.516-0.000=0.516
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.086-0.161=-0.076
σ0.004-0.003=0.000
min0.082-0.158=-0.076
max0.093-0.167=-0.074
cache=y
dps=1
iters=10
policies=100
mean24.048-21.409=2.639
σ0.002-0.002=-0.000
min24.045-21.406=2.639
max24.051-21.412=2.639
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.068-0.065=0.003
σ0.003-0.003=0.001
min0.066-0.064=0.002
max0.076-0.073=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1754.931=1.560
σ0.364-0.361=0.003
min1755.916-1754.367=1.549
max1757.081-1755.516=1.566
mean1653.900-1628.250=25.650
σ629.168-619.757=9.411
min619.000-623.000=-4.000
max2690.000-2757.000=-67.000
mean2.350-2.814=-0.464
σ0.104-0.252=-0.148
min2.239-2.286=-0.046
max2.652-3.114=-0.462

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-272.788=51.978
σ0.048-0.006=0.042
min324.681-272.781=51.900
max324.793-272.794=51.998
mean2690.000-2757.000=-67.000
σ0.000
min2690.000-2757.000=-67.000
max2690.000-2757.000=-67.000
mean0.427-0.382=0.045
σ0.010-0.008=0.002
min0.420-0.377=0.043
max0.445-0.395=0.050
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1933.230=52.087
σ0.020-0.004=0.015
min1985.284-1933.227=52.057
max1985.332-1933.238=52.095
mean2690.000-2757.000=-67.000
σ0.000
min2690.000-2757.000=-67.000
max2690.000-2757.000=-67.000
mean2.617-3.044=-0.427
σ0.079-0.348=-0.269
min2.558-2.735=-0.177
max2.733-3.593=-0.860
iters=5
new-facts=6402
prior-facts=1
mean4808.975-4756.641=52.333
σ7.796-7.438=0.358
min4805.048-4752.497=52.550
max4822.914-4769.918=52.996
mean2690.000-2757.000=-67.000
σ0.000
min2690.000-2757.000=-67.000
max2690.000-2757.000=-67.000
mean9.029-8.405=0.623
σ0.132-0.362=-0.230
min8.889-7.982=0.907
max9.234-8.919=0.315
iters=5
new-facts=6402
prior-facts=6402
mean4996.494-4944.461=52.033
σ0.178-0.020=0.158
min4996.285-4944.433=51.852
max4996.640-4944.477=52.163
mean3058.800-3041.800=17.000
σ293.251-272.668=20.583
min2690.000-2757.000=-67.000
max3333.000-3422.000=-89.000
mean8.914-8.483=0.431
σ0.415-0.112=0.303
min8.568-8.366=0.202
max9.554-8.624=0.931

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.952-1.012=-0.060
σ0.057-0.136=-0.079
min0.917-0.918=-0.000
max1.050-1.232=-0.181

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.215-468.337=-5.122
σ574.773-574.292=0.481
min175.813-181.186=-5.373
max1325.373-1329.775=-4.401
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2690.000-2757.000=-67.000
σ0.000
min2690.000-2757.000=-67.000
max2690.000-2757.000=-67.000
mean0.564-0.486=0.078
σ0.578-0.405=0.173
min0.272-0.282=-0.010
max1.431-1.094=0.337
policies=20
mean1758.505-1812.183=-53.678
σ0.333-0.380=-0.047
min1758.295-1811.932=-53.637
max1759.001-1812.748=-53.747
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2690.000-2757.000=-67.000
σ0.000
min2690.000-2757.000=-67.000
max2690.000-2757.000=-67.000
mean2.717-2.806=-0.089
σ0.012-0.009=0.003
min2.704-2.795=-0.091
max2.729-2.816=-0.087
policies=200
mean17592.116-18129.029=-536.913
σ0.421-0.398=0.023
min17591.847-18128.761=-536.914
max17592.744-18129.619=-536.875
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2690.000-2757.000=-67.000
σ0.000
min2690.000-2757.000=-67.000
max2690.000-2757.000=-67.000
mean27.450-28.428=-0.978
σ0.029-0.119=-0.090
min27.432-28.322=-0.890
max27.492-28.586=-1.093