We cannot forget that we also loose something with working remotely (say more than 75% of the time) and that is the occasional bumping into each other at the water cooler or in the morning when coming in. These are situations you can artificially create by scheduling calls to socialize etc, but that is still not comparable with being in an actual office.
By categorically saying no to quick calls, you're isolating yourself even more. While it can be distracting to jump on a call while you actually meant to focus on some coding, it can also be great to have a quick chat and brainstorm about an idea rather than let the other person work out the solution in isolation only for me to then suggest a totally different approach in the PR review (yay! asynchronous!).
By categorically saying no to quick calls, you're isolating yourself even more. While it can be distracting to jump on a call while you actually meant to focus on some coding, it can also be great to have a quick chat and brainstorm about an idea rather than let the other person work out the solution in isolation only for me to then suggest a totally different approach in the PR review (yay! asynchronous!).