I believe that it is much better to work with someone who is knowledgeable and would occasionally give you a tough time than with people who you are highly comfortable with. This way, any potential hurdles/conflicts are handled professionally making you grow as a person. Another benefit is seeing discussion points from another department’s point of view. I recall once trying to push a change that made a lot of sense for my department but was a non-starter for another department down the line. You may not always get to choose who you work with but as long as you get to grow professionally, I do not see anything wrong with a bit of a challenge here and there. It is work and there are competing interests from different departments but ultimately you are trying to get things done together which is the basis of team work.