pil0u
Joined 5 years ago
Joined 5 years ago
I wished there was such a tool before picking my hardware, it's useful. But the estimates needs to be somewhat correct.
Somehow, I wish we would leave that creature alone. For once.
> Write me a coherent paragraph in French, without ever using the letter "e".
> Voilà une phrase claire et concise : "Le village est situé dans les montagnes. Le soleil est haut. Il y a des animaux dans le village. Il pleut dans les montagnes."
I suppose this is just a demo of how fast an LLM can be, I wonder if there are tradeoffs with larger/smarter models. Also, for a human usage, at what point are tokens generated fast enough that it's pretty much instant? My bet is below 1000 tps
I recently followed through the Marie Kondo methodology, and giving up my cables (the ones I actually don't use, the ones "I might need later, some day, maybe") to my local community was a relief. Cables are obviously a tiny proportion of what the methodology covers, but part of my mental load anyway. Now, I know they have a greater chance to be used, and if I ever need one again, all of these cables are common enough to find them again.
I hope Adam and the team are well and good with this decision. Tailwind is regularly debated here for various reasons, using it helped me have a better understanding of CSS, HTML and design, and made me a better software engineer. Thanks for building and sharing Tailwind!
Suppose I have 100GB of unified memory, how should I know which model suits it best? I understand how a 2.4T model wouldn't fit, but I don't understand the impact of quantization and whether I should use a 200G model quantised to fit say 90GB of memory, or a non-quantised 90G model.
I helped Claude build a simple web app (static, local, oss) to make you choose among pairs, to progressively determine your personal preference.
It outputs your top 3, you can share the summary like this:
Recto Verso Euro
My top euro banknote designs:
Design H
Design D
Design B
→ https://pil0u.github.io/recto-verso-euro/#r=HDBJIGECFA&c=68
It's very WIP, but I found this approach useful to fill the survey, so why not share