I think it's a good idea to experiment with and discover the limitations of small, untuned models before exposing yourself to the modern very powerful ones. It gives you a better sense of their nature as token predictors and not real sentience.
In the same way, seeing an incompetent stage magician fumble before you see a very talented one perform flawlessly will help you understand that it's all sleight of hand. If you jump right to a professional performance, you might think it's real magic.
In the same way, seeing an incompetent stage magician fumble before you see a very talented one perform flawlessly will help you understand that it's all sleight of hand. If you jump right to a professional performance, you might think it's real magic.