schyzomaniac
Joined 2 years ago
Karma
38
Submissions
29
Member since
Dec 30
when i was a boy the dead sea was only sick
View on Hacker NewsJoined 2 years ago
i love the 27b model, and i use it basically daily. however when i tried to finetune it for a task in a low resource language, unfortunately i did not succeed: lora just did not picked up the gist of the task, full finetune lead to catastrophic forgetting.
may i ask four your advice, or do you have any general tips how to do that properly?
thanks in advance for your help :)
I learned that lesson the hard way."
These are all internal memos that were made available for your perusal that you would likely never see otherwise!