drittich

I love this and feel it would be greatly enhanced with semantic search.

I have the opposite experience. Plex, nextcloud, minecraft servers, and ~10 websites are all hosted on a Beelink N100. It stays cool and quiet.

Interesting - have you done MiMo-v2.6-flash?

Often the smartest thing is to do nothing.

API Error: 529 Overlorded

Things like the number of GPU layers, whether to use flash attention or not, enabling MTP, playing with context size.

There are certainly challenges. When setting up a new model, I get AI to walk me through the commands using llama-benchmark that determine the best parameters for my particular configuration and needs. Once you've got that it's pretty easy to port those parameters to llama-server. It takes me about an hour to run through this process. It would be great if there was a registry of hardware, models, configuration parameters, and resulting tokens per second. Maybe one day we'll get there.

And I thought I was killing it just saving some install disk images!

Nanobanana for scale.

...is the camera you have with you.

I used to invent TLAs on the spot for fun, and when someone asked what it was, would respond, "It's a PUA", eventually revealing that meant "previously unknown acronym". It was even more annoying that it sounds.

I think the point is to reproduce the sound of those hundreds of feet of standard run-of-the-mill cabling as faithfully as possible ;)