Comment by txhwind

If we assume resources are infinite, any effort would look ridiculous. To achieve great goal, we have to limit ourselves deliberately on some aspects. It reminds me that "compression is intelligence". By limiting the parameter space, the LLM could extract deep representation from training data.