oaguy1

I also trained nanoGPT on TinyStories, produced about a 32M model. The results are amazing, especially considering I opted for a character-level model similar to the toy dataset in the repo. I’m writing about the experience while also doing a deep dive into the code on medium (username oaguy1). Smaller LLMs are definitely worth considering with the right quality training data. Once I finish playing with TinyStories, I recently tweaked the Standardized Project Gutenberg Corpus (~11GB) to be more modern. Want to see what I can do with it with nanoGPT and then maybe Huggingface’s libraries.

Hugged to death and I’m afraid there is no wayback archive right now.

Has anyone here tried using WireGuard as a VPN for selfhosting? It is built into the Linux kernel (starting in 5.4?) and has lots of tutorials. Thinking of using it for my next project.

This is a really cool, small utility!

TBH, I have been wondering if there is a "wishlist" of small utilities/apps people would want to see on the Linux desktop. I have been looking for project inspiration and would love to do something that actually gets used.