Comment by ai_what

It won't. Amazon kind of when that angle with MistralLite[1] (a 7B finetune), and it was barely passing in terms of being an effective summarizer. 0.5B are pretty much useless.

https://huggingface.co/amazon/MistralLite