Comment

Comment by amrrs

The problem with these Open weights LLMs hosted by these provider is that we don't what's the precision of the LLM, that makes a huge difference in the speed and cost (compute).

I think Together recently introduced a different price tier based on precision but otherwise it is usually dark.

parent amrrs 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton