Comment by wren6991

Yeah, orthogonalisation is a special case of a rank-1 LoRA.