Comment by kochbeck

If you want to stay in JS, check out Pocketsphinx (http://syl22-00.github.io/pocketsphinx.js/). If you can get outside JS, look at Sphinx or Kaldi. As an alternative, if you're on mobile, both Android and iOS have local recognizers.