tcdent
Joined 17 years ago
Joined 17 years ago
That tells us that the latter (for their intended use) is a superior design.
And then the ability to enforce a formalized layer between crates and the way that they assemble into your application (i.e. the public API) is powerful for comprehension and maintainability. I go as far as documenting each crate with its own README that presents it as a standalone component with usage instructions, much like an open source library, even if it's only ever used in a single system.
Because even if you're doing this in-memory replacement, the content still lives in they system's memory. So, it makes it less obvious to leak a credential, but it certainly doesn't prevent it.
I fully expect that we will see increased performance from smaller architectures (to a point) simply because they are refined using larger ones.
> The problem is if we can pack a Fable in Qwen 4 27B who will pay subscription prices?
This is available to everyone developing these systems. Prices per relative unit of intelligence will continue to decrease. And market economics will continue to drive the cost down.
Personally, with side projects and tooling, go nuts. There's no reason to read all of that code.