Discussion

Ask HN: Options to Deploy LLMs?

To deploy fine-tuned LLMs there are these options yes?

1. HuggingFace 2. Runpod 3. Bedrock 4. FireworksAI 5. TogetherAI 6. Replicate 7. Modal

Any other that I'm missing? What do you prefer and for what use, i.e. fine-tuned vs just inference as is.

1 points johhns4 2 years ago 0 comments

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton