I’m not sure why you think this is ai slop. I work on tokenization research full time. My name is Craig Schmidt and I have a number of papers in the field. This researcher has done some very impressive work and I’m trying to defend him from the HN dismissive hoards.
There is a serious research community on tokenization, and we are quite interested in this work.
There is a serious research community on tokenization, and we are quite interested in this work.