I know, I mentioned it because there's a category of models that I'd be okay with, but I can't exactly name it. I thought the difference lied in the encoder/decoder distinction. As a sibling comment mentioned, generative models do offer more privacy risks.
But it's not only that. Model size, for instance, also plays a role. Will modern BERT keep their lossy compression nature? Or could there be a privacy risk
as well?
Thus, what are the characteristics of privacy-aware models? So far: discriminative vs. generative, model size, and lossy transforms (related to size). Perhaps looking at pre-2020 models could help to narrow other necessary attributes.
But it's not only that. Model size, for instance, also plays a role. Will modern BERT keep their lossy compression nature? Or could there be a privacy risk as well?
Thus, what are the characteristics of privacy-aware models? So far: discriminative vs. generative, model size, and lossy transforms (related to size). Perhaps looking at pre-2020 models could help to narrow other necessary attributes.