edstarch
Joined 1 year ago
Joined 1 year ago
It can be slimmed down pretty aggressively: turn off a few features (claude.ai connector sync, artifacts), work with Claude to disable / defer as many skills and tools you don't need (e.g. SendFeedback), use `--system-prompt ""`. Would be better to just skip all that to begin with but that's the cost of a subsidized fixed price plan.
This doesn't show up as much where the verifiable reward is "code compiles and tests pass" but you can still absolutely see it in things like movies, prose, or slide decks. Even frontier models are pretty bad at keeping track of narrative threads even as the technical quality drastically improves.
This begs the question of whether the gap can be closed just with more compute (presumably yes, or at least errors can be minimized beyond human capacity to see them) and is that going to be worth it with current tech (possibly no).
You really should, yeah. I've given up Linux as a daily driver in favor of a MacBook but I do have a work mandated Windows machine and I hate that thing with a passion. I cannot think of a single thing that's better on it than on my MacBook or any Linux distro I've ran as a daily driver.
In fact, most of the time I want to do any tasks which are not directly Teams or MS office related I find it easier to just use WSL.
Shower thought: what does a typical conversation with an LLM look like? You ask it a question, or you give a command. The model spends some time writing a large wall of text, or performing some large amount of work, probably asks some follow up questions. Most of the output is repetitive slop so the user scans for the direct answer to the question, or checks if the tests work, promptly ignores the follow-ups and proceeds to the next task.
Then the user goes to an online forum and carries on behaving the same way: all posts are instrumental, all of the replies are just directing, shepherding, shaping and cajoling the other users to his desired end (giving him recognition and a job).
I'm probably reading too much into this one dude but perhaps daily interaction with LLMs also changes how one interacts with other text based entities in their lives.