Comment

Comment by rasengan0

Got Qwen3.8 to run on my Framework 12 Intel Core 13 Gen Raptor Lake i5-1334U small laptop with 48G RAM stick:

llama serve -hf unsloth/Qwen3.8-27B-GGUF:UD-Q4_K_XL

but it failed my basic prompt to compose a vim regex to match CamelCaseWords

downgraded a bit with Q4_K_M from ollama run qwen3.8:27b

and /set nothink and at least 1 regex matched FooBar

prompt eval at 2.8 t/s eval at 0.94t/s

I particularly enjoyed this usage of the regex: /%\1\%/ ... onward for 700+ characters of \%\/ :-)

parent rasengan0 2 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton