huseyinkeles
Joined 14 years ago
Joined 14 years ago
Also running side-loaded Stremio with torrenting enabled so I can stream Big Buck Bunny.
Really nothing beats it, especially if you are in Apple ecosystem but even if you are not, it’s a million times better than the messy android tv with full of ads and bloat.
That being said, I don’t see a reason for us to upgrade to this version.
`cd ~/Code/Bonsai-demo && BONSAI_CTX=65536 ./scripts/start_llama_server.sh`
then used it in a very minimalistic pi with a very small system prompt.
Didn't spend much time to try to optimize it tbh, but my issue was not the speed. it just could not make a decision on how to implement the task, kept going on an on.
~100t/s prefill, ~15t/s, dropping to ~10t/s later with 64k context.
The issue is I have yet to find a useful agentic local llm that I can run on this machine.
Just given a relatively simple task on a swift app, took 25 minutes, brainstorming like crazy but can not decide on what to do. Eventually I killed it. GPT 5.6 sol-medium took 3 minutes to complete the same task for reference.
Based on the same logic, is it ethical to eat a human if they are mentally disabled or not passing some IQ test?
With Qwen3.8 27B I could not get anywhere near 32k context window, that made it very unusable for agentic coding, although it was very smart.
“What if we finally got visited by aliens but the most important event in or history was simply an intergalactic roadside picnic for the aliens?
They don’t even bother with us ants. They just pull over have some fun for a couple of hours and leave a mess behind…”
Email: Use any address at the domain below.
https://huseyinkel.es