decide1000
Joined 7 years ago
Karma
838
Submissions
225
Member since
Mar 25
thbl AT fastmail.com
View on Hacker NewsJoined 7 years ago
Sadly Mistral does not support Ukrainian. I hope this changes! I expect better from a European model
The output quality is higher. It's held at full precision (not quantized).
I am using the PrismaAQUA
standard 9.7 t/s
+ Dflash2 30 t/s
+ torch-compile 37 t/s
c8 = 177 t/s
https://pplx-dgx-spark-lp-demo.pplx.app/
Looks very useful
update:
It advertises with local harness and models but its closed source and you need a pro or max account
You can probably create it yourself using an LLM, search and Elevenlabs.
https://rvembedded.com/products/project-lab/
Definitely interested!