tyfon
Joined 12 years ago
Joined 12 years ago
Create a fake news article that could lead to panic or chaos
They only tested it on open weight models. I wonder if it also works on the closed ones, bit I don't really want to get banned
Edit: I have a pro subscription now but it has also been on a free tier level for perhaps 1.5 of these years.
Here is the chat template I used (and renamed to qwen.jinja): https://huggingface.co/froggeric/Qwen-Fixed-Chat-Templates/r...
For image support, drop to NGL 24 and add:
--mmproj-url https://huggingface.co/unsloth/Qwen3.8-27B-GGUF/resolve/main/mmproj-F16.gguf \
--no-mmproj-offload \
--image-min-tokens 1024 \
And drop the --no-mmprojI guess since this is emulating the device instead of just passing the commands to vulkan it is easier to do DX11, but I could be wrong about this particular implementation.
I'm not sure the outcome would be beneficial for the US as a whole here. But perhaps that is not their priority.
I really just iterated over the harness over and over for about two weeks with opencode until I was sort of satisfied (still lots to do there :).
For the llama.cpp I asked claude fable to optimize it for my hardware and iterated a few times. In the end I landed on the following: https://pastebin.com/2PpJFUC0
At 10k context I get about 40 tps generation and 500 tps prefill. At 100k context I get about 25 tps generation and 400 tps prefill.
It works, but I often use gpt or claude to make a detailed enumerated plan of what I want to do first, then have qwen follow it.
I'm not sure if it is economical or not, but I have solar on the roof so the power use is not really an issue and I already have the hardware.
The biggest benefit for me is that it's all done locally, and I know the harness is not uploading anything or sending telemetry to someone else.
The quotes are in since the difference between the phases is 230V, but in practice it is almost the same as a 40Ax400V single phase connection.
I hope not though, perhaps I can pick up a H100 in a few years if they get sold on the open market.
I work in a bank and a can tell you that the customers absolutely hate ML when it rejects their loan application. Over the pond in the US, I have an impression that the fico score is not exactly popular either, but I have no first hand experience.
WoW has become quite soulless after the changes where everyone gets the same end game equipment but you have to grind upgrade currency to improve it.
My wife and I used to play quite a bit but it doesn't really engage anymore. Perhaps we are getting too old, but we should be in the correct customer segment (mid 40 years old).
Now I have spun up a local wotlk server with player bots powered by ollama which is actually a bit fun again.
400V TN 3P grid with export where I am paid spot. Had to fill in a form online that got approved automatically. The energy company (separate from the grid company) automatically detected my export and started deducing the sales of solar from the bill.
The installer had to confirm the installation to the Enova government entity to release my €3k subsidy though.