That's right. It's a symbol. When you see it in an expression, you're probably expected to interpret it in light of a limit of some kind. It's just convenient to write it into an expression rather than use cumbersome limit notation all over the place.
Like many notational shortcuts, it's a hack supported by proof. ;-)
Like many notational shortcuts, it's a hack supported by proof. ;-)