Comment Comment by jaan Does it support constrained generation during training?This is what we need for the large language models I am training for health care use cases.For example, constraining LLM output is currently done by masking, and having this rust based library would enable novel ways to train LLMs.Relevant papers:https://github.com/epfl-dlab/transformers-CFGhttps://neurips.cc/virtual/2023/poster/70782 parent jaan 2 years ago
This is what we need for the large language models I am training for health care use cases.
For example, constraining LLM output is currently done by masking, and having this rust based library would enable novel ways to train LLMs.
Relevant papers:
https://github.com/epfl-dlab/transformers-CFG
https://neurips.cc/virtual/2023/poster/70782