It seems to me like you have a very clear idea of what you like and what you don't like. You also seem to be self-aware enough that you notice that your mental health is suffering.
When I come to similar realizations, I make a career transition. Speaking personally, in one role I found myself managing a team of contract software developers in a different time zone. I didn't enjoy the extra communication overhead, quality issues, and the feeling of not being able to establish an interpersonal relationship with them. When I learned that our senior management was going to hire a team of contractors again I left the position. Leaving this position resulted in a pay cut but the benefit for my mental health was huge.
When I come to similar realizations, I make a career transition. Speaking personally, in one role I found myself managing a team of contract software developers in a different time zone. I didn't enjoy the extra communication overhead, quality issues, and the feeling of not being able to establish an interpersonal relationship with them. When I learned that our senior management was going to hire a team of contractors again I left the position. Leaving this position resulted in a pay cut but the benefit for my mental health was huge.