_micah_h
Joined 2 years ago
Karma
46
Submissions
12
Member since
Jan 17
Recent submissions
Comment · 2 years ago
Gemini Ultra is the model they claim will match GPT-4, not out yet!
Comment · 2 years ago
We've been waiting on Replicate to launch per-token pricing for LLMs because their previous pay-per-second model was uncompetitive - but it looks like they might have just turned it on with no big announcement! They'll go straight to the top of the priority list.
Do Lambda have a serverless inference API? Not aware of them playing in this space yet.
Presume you mean MPT not MPS - yep we'll look into MosaicML soon.
Comment · 2 years ago
Hey, yeah the bar for adding finetunes will probably be that they're being hosted by ~3 supported hosting providers. Very much open to it!
Comment · 2 years ago
Check out the graphs over time on the model pages - https://artificialanalysis.ai/models/gpt-4-turbo-1106-previe....
OpenAI are doing a ton of load balancing, presumably constantly tweaking batch sizes to try to optmize across all their workloads.
You can test the GPT-4 vs GPT-4 Turbo on Playground to intuitively confirm that the speeds are similar.
Comment · 2 years ago
Hey, yep looks like they updated their pricing - we've now updated it on the site!