I don't think it is. I think you could detect sandbox escapes reliably more often than you could actually prevent sandbox escapes (which is, itself, very high). If you had an external watchdog that looked for unusual processes running on your machine, that looked for unusual connections being made, you could detect even very sophisticated attacks.
> If you think about this in an evolutionary context, What you're doing is putting even stronger pressures on the AI to evolve in a manner you don't want it to
No, because we are using failed sandbox escapes as negative training examples. So >99.99% of the time when the AI attempts to escape the sandbox, that will produce another training example that will cause it to try and escape the sandbox less. The remaining <0.01% of the time it will be pushed to try and escape the sandbox. The 99.99% will have a much stronger influence than the 0.01%.
I don't think it is. I think you could detect sandbox escapes reliably more often than you could actually prevent sandbox escapes (which is, itself, very high). If you had an external watchdog that looked for unusual processes running on your machine, that looked for unusual connections being made, you could detect even very sophisticated attacks.
> If you think about this in an evolutionary context, What you're doing is putting even stronger pressures on the AI to evolve in a manner you don't want it to
No, because we are using failed sandbox escapes as negative training examples. So >99.99% of the time when the AI attempts to escape the sandbox, that will produce another training example that will cause it to try and escape the sandbox less. The remaining <0.01% of the time it will be pushed to try and escape the sandbox. The 99.99% will have a much stronger influence than the 0.01%.