Comment by adevine

As you say, though, it all depends on tone. Excuse me can either be respectful, or it can be an accusation that you're being rude. When it's the latter, what the speaker really means is "Excuse you!"