scronkfinkle
Joined 8 months ago
Joined 8 months ago
A surprising amount of tracking and diffing in legal texts is actually very different to git. It's a trap to assume software version control fits the needs for legal work.
It's weird to think of these kinds of models as having "output tokens". Cross-encoder approaches like Laya add a [MASK] marker per option, but nothing is generated the way an autoregressive transformer generates. It's one bidirectional pass over your input, then a small head scores each option, so you wouldn't really pay for output as much as only input
It's so easy that I question why I would ever pay for JEV when eventually I'll have done enough random things that I will also have a large corpus and likely a general model as well.
It's still pretty undisputed that if you know how to write code, you can generate better AI code than someone who doesn't, and do it with less tokens. I think it's more like in university where in other engineering disciplines you learn the math and underlying concepts and are forced to do them by hand. This gives you an understanding of what you're doing, but in the real world you, ya know, just plug that stuff into matlab.
Oh man, if you read the threads about that it's such a time capsule of a different era:
e.g. from this thread: https://news.ycombinator.com/item?id=31628342
> I am honestly surprised how little SPAM there is on GitHub in general. Please don’t take that as a challenge!
I get a funny feeling in my stomach over the idea that common and effective means of communication (i.e. it's not X it's Y) have become faux pas to use because of AI. I think it's something about these phrases being taken away from us more-so than the AI inventing them.
Leaving it all completely deregulated and/or letting platforms implement it themselves to varying levels of success and personal invasion feels like the worst option to me.