After reading this article [1], I created a small "disconnect box" that sits by my front door (it's a repurposed iphone box). When I'm home, and especially when the kids are awake, the phone stays in there. I can hear if someone calls, but otherwise notifications are off. Working quite well so far!
[1] https://www.theglobeandmail.com/technology/your-smartphone-i...