Comment by chkuendig

This is exactly how Amazon Echo does it:

Amazon Echo uses on-device keyword spotting to detect the wake word. When Amazon Echo detects the wake word, Amazon Echo streams audio to the Cloud, including a fraction of a second of audio before the wake word.

http://www.amazon.com/gp/help/customer/display.html?nodeId=2...