I hope readers aren't getting the impression from this article that the code examples provided are the correct way to do word segmentation in English. (Though I understand this is an article about interviewing and not about word segmentation. And this might be considered a preprocessing step for doing things correctly...)
Norvig gives a very approachable version of English word segmentation that uses a language model below.
Norvig gives a very approachable version of English word segmentation that uses a language model below.
http://norvig.com/ngrams/