dhruvdh
Joined 7 years ago
Karma
557
Submissions
153
Member since
Apr 26
Recent submissions
Comment · 9 months ago
Try `uvx pocket-tts serve`
Comment · 1 year ago
El Capitan can also do FP8. HPC requires double precision generally but people are trying to make low precision work.
Comment · 1 year ago
To be fair, you can buy ~3 of these for the price Nvidia charges for 24GB/32GB models.
Comment · 1 year ago
To add, AMD only makes _parts_ of an MI300X server.
It's like asking a tire manufacturer to give you a car for free.
Comment · 1 year ago
I wish more people would just try to do things just like this and blog about their failures.
> The published version of a proof is always condensed. And even if you take all the math that has been published in the history of mankind, it’s still small compared to what these models are trained on.
> And people only publish the success stories. The data that are really precious are from when someone tries something, and it doesn’t quite work, but they know how to fix it. But they only publish the successful thing, not the process.
- Terence Tao (https://www.scientificamerican.com/article/ai-will-become-ma...)
Personally, I think failures on their own are valuable. Others can come in and branch off from a decision you made that instead leads to success. Maybe the idea can be applied to a different domain. Maybe your failure clarified something for someone.
Comment · 1 year ago
Disappointed that there wasn’t anything on inference performance in the article at all. That’s what the major customers have announced they use it for.
Comment · 1 year ago
Which algorithm you pick for what shape of matrices is different and not straightforward to figure out. AMD currently wants you to “tune” ops and likely search for the right algorithm for your shapes while Nvidia has accurate heuristics for picking the right algorithm.
Comment · 2 years ago
> despite them being fabless
That's not how it works. You need to pump money into fabs to get them working, and Intel doesn't have money. If AMD had fabs to light up their money, they would also have a much lower valuation.
The market is completely irrational on AMD. Their 52-week high is ~225$ and 52-week low is ~90$. 225$ was hit when AMD was guiding ~3.5B in datacenter GPU revenue. Now, they're guiding to end the year at 5B+ datacenter GPU revenue, but the stock is ~140$?
I think it's because of how early Nvidia announced Blackwell (it isn't any meaningful volume yet), and the market thinks AMD needs to compete with GB200 while they're actually competing with H200 this quarter. And for whatever reason the market thinks that AMD will get zero AI growth next year? I don't know how to explain the stock price.
Anyway, they hit record quarterly revenue this Q3 and are guiding to beat this record by ~1B next quarter. Price might move a lot based on how AMD guides for Q1 2025.
Comment · 2 years ago
> Performance per watt was better for Intel
No, not its not even close. AMD is miles ahead.
This is a Phoronix review for Turin (current generation): https://www.phoronix.com/review/amd-epyc-9965-9755-benchmark...
You can similarly search for phoronix reviews for the Genoa, Bergamo, and Milan generations (the last two generations).
Comment · 2 years ago
Is AMD behind hyperscaler in-house efforts? Outside of Google I don't think so.
Comment · 2 years ago
Oh, maybe also change the title? I flagged it because of the title/url not matching.
Comment · 2 years ago
I don't think having a common ancestry for the ISA means much, or even having the same ISA.
Anyway, I don't understand what you want from me or are arguing about. They were trying to win the datacenter CPU market and not the GPU market. They did well at that. They've recently started trying to win the GPU market as well, cause now they can afford to. They seem to be doing well now.