lwarfield
Joined 5 years ago
Joined 5 years ago
He's also the inspiration for one of favorite characters in fiction, Sherkaner Underhill from A Deepness In The Sky*. :)
You should even be able to create a j lens from scratch, but it might take a while. I was able to do it in a few hours on an H100. Creating the J lens is basically the equivalent of calculating a few thousand training steps for a model (256,000 backprops in my case). I've got more details in a blog post:
https://blog.lwarfield.dev/layer-scope/
I'm currently at work and can't those matrixes up until I get home. I'll update this comment with a link later.
I haven't gotten much out of for using LLMs though. It makes me understand the short comings of LLMs, and I feel like I got an early insight into how important context management is.
Overall I've been hooked on using agents from different companies for what they are best at (Thanks to Theo). Fable is expensive, but unmatched for planning and top level organization of other agents. Sol is fast, will persistantly go after goals (sometimes to its detriment), and does well with computer use.
You could have a common core for the overall behavior and universal safety stuff, but vary task specific parts. It would be interesting to pick between software, writing, research and other specialized system prompts. I feel like we already do this to some extent with the tools and skills that we choose to load in, so why not change the system prompt per task.
> Same model weights as Mythos 5, deployed with higher-coverage safeguards (see Section 4.5.2.2)
>6.3 [Appendix redacted] > This appendix, redacted from the public version of this report, details the changes made to our constitution to expand classifier coverage to harmful uses in scope for the CB-2 threat model but not the CB-1 threat model, as described in Section 4.5.2.1.
interesting...
EDIT: After reading more I'd recommend looking at Transcript 2.20.A. Its a transcript of claude going over the redactions in the report. The section says its specifically for section 2, but the transcript also mentions other sections.
This sounds like it might be a Mythos finetune for some specific task.
EDIT: After reading some more reading, it looks like model 2 might be an AI research fine tune based off the section 3.4.3 CoBench
In an ideal world Balcony Solar shouldn't exist because grid power is cheap and plentiful.