Comment Comment by jacquesm > It is absolutely not a thing in any practical sense that relates to detecting post-trained backdoors, no.> Or provide a source showing how to do this (and not just a circuit paper showing which activations light up with the word dog)The fact that you're not informed does not place a burden on me.https://www.crowdstrike.com/en-us/blog/crowdstrike-researche...This is all just a sub-class of supply chain attacks.You don't have to be able to explain every aspect of a model to be able to inspect for undesirable traits. parent jacquesm 12 days ago
> Or provide a source showing how to do this (and not just a circuit paper showing which activations light up with the word dog)
The fact that you're not informed does not place a burden on me.
https://www.crowdstrike.com/en-us/blog/crowdstrike-researche...
This is all just a sub-class of supply chain attacks.
You don't have to be able to explain every aspect of a model to be able to inspect for undesirable traits.