Comment Comment by stellaathena [Disclaimer: I am an author of the above paper and played a rather minimal role. I am also a prominent member of EleutherAI.]"Instruction-tuning" is clearly in the air. Simultaneous work at Google (released less than two weeks ago) on a model they call FLAN can be found here: https://ai.googleblog.com/2021/10/introducing-flan-more-gene...EleutherAI attempted to do something similar several months ago, but didn't succeed: https://blog.eleuther.ai/tuning-on-eval-harness/A careful analysis of the similarities and differences between the three approaches would be likely highly beneficial to the community. parent stellaathena 5 years ago
"Instruction-tuning" is clearly in the air. Simultaneous work at Google (released less than two weeks ago) on a model they call FLAN can be found here: https://ai.googleblog.com/2021/10/introducing-flan-more-gene...
EleutherAI attempted to do something similar several months ago, but didn't succeed: https://blog.eleuther.ai/tuning-on-eval-harness/
A careful analysis of the similarities and differences between the three approaches would be likely highly beneficial to the community.