Comment by OmarIsmail

You can make an exception for the pager duty providers number. That will it will always make a sound no matter what.