Recent submissions

Comment · 2 days ago
Comment · 2 days ago
Not sure if it is competitive but DeepSeek's models are under the mit license, including their most recent one.
Comment · 6 days ago
The model itself (Qwen 3.8 27B specifically) can handle being interrupted just fine and i often interrupt it to clarify things when i see it finding my instructions vague or to add some extra info.

However there is a bug somewhere between my instructions and the model - i think it is the jinja template, though i'm not sure as i haven't actually looked too deep into it - that in some cases make my last message be sent repeatedly to the model after each tool call, making the model think that i'm getting impatient or something :-P. When i notice it, i tell the model that this is some harness bug and it can ignore the repeated messages, which it does.

It seems to happen when i stop it while it is thinking after a tool call but i'm not certain. I try to stop it while some tool call is in process so it cancels the call as that seems to avoid the issue. Restarting llama-server also seems to make the issue go away so it might be a llama.cpp bug, but TBH i haven't found a clear repro case aside from it happening when i interrupt it while it is thinking. I think it is more common when the context is close to full, or at least i mainly remember it happening when i've been using a session for some time (i.e. not in fresh sessions, which does make reproducing it a bit harder).

In any case, the model itself seems to deal with all the above fine (and accepts the bug explanation for repeated messages), it is the rest of the stack that can show an issue with interrupting it (but even that is relatively rare).

Comment · 6 days ago
As i wrote in the other comment, i know, i just meant is that the process i use isn't driven by a harness but done manually. The PDF i quoted mentions a harness does that driving so i wrote "There isn't any real harness driving this" to mean that i do that by hand instead of being done automatically.
Comment · 6 days ago
I can't edit it to clarify, but what i meant is that the process i use isn't driven by a harness but done "by hand", not that there isn't any harness at all. The PDF describes a harness that is actually used to drive the manager/worker role.
Comment · 6 days ago
Yeah though AFAIK it is discontinued now (or at least i can't find it in the local price aggregator). I think R9700 is a decent alternative, a bit slower (256bit bus vs 384bit bus) but has 32GB of RAM, still isn't too overpriced (at least compared to Nvidia alternatives) and has an opensource stack too (which is why i went with AMD in recent years).
Comment · 6 days ago
I'm using Qwen 3.8 27B with Unsloth's UD-Q4_K_XL quantization[0] via llama.cpp with 131k context - full command line:

llama-server --model Qwen3.8-27B-UD-Q4_K_XL.gguf --ctx-size 131072 --parallel 1 --cache-type-k q8_0 --cache-type-v q8_0 --host 0.0.0.0 --port 8080 --spec-type draft-dflash --spec-draft-model dflash-Qwen3.8-27B-Q4_0.gguf --spec-draft-n-max 3 --spec-draft-type-k q8_0 --spec-draft-type-v q8_0 --mmproj mmproj-BF16.gguf --no-mmproj-offload --image-min-tokens 2048 --reasoning-preserve

It just barely fits in my RX 7900 XTX's 24GB of VRAM (TBH i'm not sure if dflash is much better than MTP - which is included as part of the GGUF - and MTP saves ~1GB of VRAM). I'm using Linux with Xorg/Window Maker as my DE so it uses no VRAM at all (Qt-based stuff - and i guess modern Gtk too - tend to use some VRAM for themselves, even opening Kate shows up in amdgpu_top :-P). The above gives me on average ~50 tokens/sec generation (drops to about 35 when the context is close to full) and ~700 tokens/sec prompt processing, which while not particularly speedy is fine for agentic stuff as i just give the AI a task and leave it in the background doing things. To save some VRAM i run the multimodal projector for vision on the CPU (the --no-mmproj-offload) and only one task is ever executed at the same time (--parallel 1). Also the kvcache is quantized to q8_0 - supposedly this makes the model a bit dumber, though the extra VRAM needed for the full f16 kvcache makes it more than ten times slower :-P (and AFAIK dense models like the 27B aren't as affected by it as MoE models are).

I'm using Pi[1] (a slightly older version that i've had remain offline and disabled the telemetry) for now (will replace it at some point since i'm not a fan of the ~500MB dependency tree, the almost-dark patterns for online access/telemetry and the increasingly worrying push for the devs' services, but i do like how it approaches compaction and that for the most part it doesn't need any handholding when some error happens - which is ideal for "let the AI do something and check it some time later").

It is running inside a container so it doesn't get any access to my real stuff (mainly to avoid the LLM making any mess - of which it sometimes does in the container, but well, it is contained :-P). In the container Pi gives the LLM some basic tools - read, write, edit and bash - and the last one is basically used to do most of the work (i've also made a bunch of tools the LLM can use via the CLI).

[0] https://huggingface.co/unsloth/Qwen3.8-27B-GGUF/blob/main/Qw...

[1] https://pi.dev/

Comment · 6 days ago
Interesting but (from the PDF):

    Every role but the verifier is the same
    underlying model, called in a fresh context
    and coordinating through a shared workspace on disk:
    
    <ws>/task.md - the problem statement
    
    <ws>/plan.md - the manager’s overarching plan
    
    <ws>/tasks.json - a debug mirror of the task list
    
    <ws>/notes.md - curated ideas / findings / partial proofs
    
    <ws>/solution.py - the current solution
Then they describe how there is a ping-pong between manager and worker with fresh context for the worker, but i wonder, is that part or even the worker really necessary?

My use of Qwen 3.8 27B (which is the only model i use almost since it came out) is really doing something very similar to the above where first a task is described, a `PLAN.md` file is made with the (current) plan and tasks are either in the plan file or in a separate issue tracker the LLM has access to via a CLI tool, a `STATUS.md` that tracks the current status and a `GOTCHAS.md` file for writing down various notes/tidbits/gotchas (TBH this is largely because Qwen 3.8 27B does want to note down stuff anyway so it mainly acts as an attractor for not writing its notes down in the other two places :-P).

There isn't any real harness driving this, i just give it a task, tell it how it'll be handled and off it goes. I guess i'm playing the "role" of the harness there as i tell it to not go and do everything in one go :-P but i never bother with fresh contexts, Pi's "rolling" approach to compaction (i.e. summarizing the older messages to make space while keeping the recent messages as-is) make it almost a non-issue.

I have considered making it a planning tool, though as some tool it can use via the CLI (it is running in a container), not a harness - but at the same time it feels like it can do the same thing with the `PLAN.md`/`STATUS.md`/`GOTCHAS.md` triplet. The only thing the tool would help with is to provide a UI for me to check what it's currently doing, but even then i usually just stop it and ask it directly :-P then tell it to continue.

Perhaps at some point i'll make some custom benchmark with stuff that are vaguely similar to what i work on and try a bunch of different approaches. It is something i want to do anyway to see how and if Qwen4 27B (whenever that comes it) is an improvement over 3.8.

Comment · 7 days ago
How so? Judging from the examples the model does seem to take advantage of the language (creates and uses reusable elements) and AFAICT the language itself compiles down to "real" Sierra PIC commands so in theory it can be used with a Sierra PIC viewer/engine.
Comment · 14 days ago
Looks like MOSS was made by some Chinese university as part of an AI education/research program so i guess they don't have to care about funding as much as the other labs :-P
Comment · 14 days ago
Looks like the people over /r/SD seem to like MOSS (i'm not up to date on the image stuff) but what i notice is that it is Apache2 licensed when every other openweight model seems to have some weird license (from a quick check Qwen-Image even downright forbids any commercial use at all).
Comment · 15 days ago
It isn't just the ancient sculptors and artists (unless 20 years ago is ancient :-P), when i went to an art school there were nude drawing lessons there too.
Comment · 20 days ago
Yes, an agent wont tell you if something is boring or funny, at least not unless you ask (and i don't think its response would have much value) but it will tell you if your instructions can be followed or not - which was the main thing the author wanted to test against, at least as far as i understood.

My point wasn't that you can use agents for all feedback, but for the given case of testing your readme file's instructions (the article's title even mentions it is about the readme file) you can certainly use agents for that.

Comment · 20 days ago
I know there are technical ways to work around IRC's limitations, my point is that their mere existence adds more friction to using IRC so people move on to more frictionless places - and with chat apps being fundamentally social, that friction affects people who don't even mind the frictions themselves but their peers do (though personally i do mind these frictions - i do not want to bother with hosting anything or setting up bouncers or anything of the sort, i just want to pop in a channel, see what people were discussing, talk with whoever is there and/or share some of my own stuff and that's it).
Comment · 20 days ago
How? From a quick search don't see anything in the spec about files or images. The closest i can think of is attaching metadata (which is a draft), but these are meant to store utf8 strings and i doubt a base64 encoded video is what the writers of the spec had in mind.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton