Comment Comment by Maschinesky What makes sense to fine-tune and what not?You said 50-1000 examples.Do I fine-tune when having specific q/a sets like from real customers and I want to add the right answer to the model?Do I fine-tune facts or should I use some lookup?Does adding some code and API docs for a current version of something I want more support make sense? Like chatgpt knows quarkus 2 but not quarkus 3 parent Maschinesky 3 years ago
You said 50-1000 examples.
Do I fine-tune when having specific q/a sets like from real customers and I want to add the right answer to the model?
Do I fine-tune facts or should I use some lookup?
Does adding some code and API docs for a current version of something I want more support make sense? Like chatgpt knows quarkus 2 but not quarkus 3