As far as I know Mycroft does its speech recognition in the cloud, so your voice has to leave your network unfortunately. This is the reason why I don't have a voice assistant yet. There was snips.ai which tried to solve this problem locally but they were acquired by Sonos.
edit: spelling