chaitanyya
Joined 2 years ago
Joined 2 years ago
They do however want strict measures in place to avoid abuse, and the export control was the only tool they had to stop Anthropic from releasing the model.
Though I also wonder if it's even possible to patch things without severely crippling the abilities of the model.
Not taking a dig at people, it was not a terrible choice earlier. Not like these models are inventing net new ways to exploit systems.
You just need to create a simple workload - think of it like an e2e test case you care about. It can be in any language or lib. Next you need to run this test in our VM.
We then simulate 100s of realistic production scenarios like slow network, different cpu scheduling etc. and save the environments where your test case fails.
Those failing environments can be inspected, you can replay then and they will always produce the exact same result.
Thank god people protested against it and made them drop the plan.
Because we have tools and techniques that can guarantee the absence of certain behavior in a bounded state space using formal methods (even unbounded at times)
Sure, it's hard to formally verify everything but if you are dealing with something extremely critical why not design it in a way that you can formally verify it?
But yeah, the easy button is keep throwing more tokens till you money runs out of money