Comment Comment by DeathArrow >This preview runs a 2B modelI guess with 1B or 500M model inference would be even faster? parent DeathArrow 5 months ago
I guess with 1B or 500M model inference would be even faster?