Comment by im3w1l

There is nothing in theory preventing you from training while keeping a subset of weights locked.