The distinction between code and data is very real, and dates back to at least the original Harvard Architecture machine in 1944. Things like W^X and stack canaries have been around for decades too.
LLMs are trying to essentially undo this by concatenating code and user-provided data and executing it as one. From a security perspective it is just a plainly stupid idea, but I do not believe it is impossible to construct a similar system where those two are separate.
LLMs are trying to essentially undo this by concatenating code and user-provided data and executing it as one. From a security perspective it is just a plainly stupid idea, but I do not believe it is impossible to construct a similar system where those two are separate.