Comment by SphericalCowww

I put my ideas here in case you are interested: https://github.com/SphericalCowww/ML_LunaLoRA