Comment Comment by great_psy This might be silly, but … since the assistant models are so much smaller than the full models. What if we just use those smaller models?Any idea how much worse they will be ? Or is the issue that their error will really diverge as you accept more of their tokens? parent great_psy 5 months ago
Any idea how much worse they will be ? Or is the issue that their error will really diverge as you accept more of their tokens?