It really depends on the use case, which the author didn't hint to (sure, they say procedurally generating text, but exactly how and for what reason?). But whatever it is, I assume it needs to be accurate to some degree, and having a deterministic ruleset is just too subjective and superficial to cover all cases.
It doesn't need to be a full-fledged LLM either. What I mean is that a probabilistic machine learning model trained on a sufficiently large dataset is probably a better choice here. Small language models are pretty efficient nowadays, even for on-device use cases with constrained resources.
It doesn't need to be a full-fledged LLM either. What I mean is that a probabilistic machine learning model trained on a sufficiently large dataset is probably a better choice here. Small language models are pretty efficient nowadays, even for on-device use cases with constrained resources.