Comment by domnomnom

Can you ELICSUndergraduate. Tokenizing is normally for if you're writing a compiler of DSL right?