HanClinto
Joined 15 years ago
Karma
1,240
Submissions
450
Member since
Nov 22
Recent submissions
Comment · 5 days ago
Yes. All you need is a formal grammar that defines the syntax of the text being generated. The llama.cpp repo has a decent writeup on the way that grammar-constrained decoding works in general [0], and it includes a bit of a simplistic example for generating syntactically-correct C code [1]. No reason this couldn't be extended to other things -- I personally have run experiments with generating syntactically-correct SQL statements when doing text-to-sql [2], and I think it's pretty cool.
[0] - https://github.com/ggml-org/llama.cpp/tree/master/grammars [1] - https://github.com/ggml-org/llama.cpp/blob/master/grammars/c... [2] - https://gist.github.com/HanClinto/b853571136fd42f8e2bde4c99c...
Comment · 8 days ago
It's not automatic, but it is the trend.
Comment · 26 days ago
I've been using 98.css [0] as a foundation for building many of my personal projects lately -- I think it's pretty great, and a really refreshing return to some older paradigms.
Comment · 26 days ago
I mirrored the bug report on the author's Github project [0], so if it helps, you can view the screenshot there.
Comment · 29 days ago
It's not a complete list, but it really reminds me of the parent comment's criteria.
If AI isn't achieving superhuman performance in all of these areas, I'm not sure we can actually call it "Humanity's Last Exam" -- it feels like a bit of an overextension.
Comment · 29 days ago
"A human being should be able to change a diaper, plan an invasion, butcher a hog, conn a ship, design a building, write a sonnet, balance accounts, build a wall, set a bone, comfort the dying, take orders, give orders, cooperate, act alone, solve equations, analyze a new problem, pitch manure, program a computer, cook a tasty meal, fight efficiently, die gallantly. Specialization is for insects."
-- Robert A. Heinlein
Comment · 1 month ago
> But play-testing on a real Chromatic requires a firmware update and API key that came in the box with the DevDay devices
That's too bad! Those blank DIY cartridges in the DevDay bundles look really sweet. Here's to hoping that they make it more general-release!
Comment · 1 month ago
Yes!! I remember reading this book at the library as a kid, and for years afterwards I wondered if I had just hallucinated the whole thing.
I think it's a really important scene, and I'm sad that it was cut from the movie.
Side note: the (extremely well-done) Star Wars Radio Drama [0] included a great many expanded scenes on Tattoine (with quite a bit of expansoin on Tosche Station), and I think those scenes (which include the aforementioned scene with Biggs) really add to the richness and flavor of the setting.
If you're a fan of Star Wars and haven't yet listened to the radio drama, I highly recommend it!
Comment · 1 month ago
No. It's not limited to 3rd-party guardrails. Given how restrictive the native public-facing OpenAI guardrails are, this feature wouldn't be worth very much if it just slacked back off to the level of "regular" filter paranoia offered by the native models, would it?
This is needed if you're going to be dealing with things like psychologists doing self-harm research or red-teaming or sensitive sexual content -- if you're working with any of that sort of stuff in a professional context and want to leverage OpenAI models on Azure, then that's the form that you fill out to get access to unfiltered models.
Note that I am not aware of this feature being offered for Anthropic models -- I've only seen it offered for OpenAI models (note that the documentation I linked is specifically in the "Azure OpenAI" category).
Comment · 1 month ago
Yes, this is well-documented and publicly advertised. In Azure Foundry, the feature to modify (or completely remove) safety guardrails and content filtering is called "Limited Access" [0], and one must submit a form to request permission to use this feature. This is one of the more straightforward paths to get access to unrestricted frontier models, but it's far from the only way.
[0] - https://learn.microsoft.com/en-us/azure/foundry/responsible-...
Comment · 2 months ago
The upcoming RTX Spark [0] is aiming to fill that space -- consumer GPUs with tons of memory.
Comment · 2 months ago
Very impressed with the Watch Dogs series of games for this purpose.
We recently used Watch Dogs Legion to prep for a trip to London to get more familiar with the city. Set the game on peaceful mode and just walked around and did virtual sight-seeing instead of playing missions. It's a surprisingly good recreation of the city, and we really appreciated getting some familiarity with the place before we visited.
Comment · 2 months ago
Maybe "Claude" is the new "Xerox", but for coding agents instead of copiers?
Comment · 2 months ago
And yours got the chain!
Comment · 2 months ago
Likewise -- also had zero issues going over this with Sol. Seemed to give solid advice for how to test it -- use an expendable bare-metal AMD family 16h test system w/ usual standard checks that apply.
> Run `platform_check` first and do not use `SKITTER_FORCE=1` casually. Start with the read-only `dram_state` and `dram_carveouts`, then `dram_dump --dry-run`. Avoid `dram_poke` until maps have been freshly collected and calibrated. Do not bypass fingerprint checks, calibration, fencing, or verification.
Claude's (apparently externally-mandated?) lobotomization continues to be concerning. :-/
https://github.com/HanClinto
hanclinto at gmail dot com