moinnadeem
Joined 14 years ago
Karma
331
Submissions
79
Member since
Nov 11
Recent submissions
Comment · 3 years ago
Comment · 3 years ago
I wouldn't go so far. I know the authors quite well, and as someone who has multiple publications in machine learning confeerences (and started a PhD in ML), they know their stuff well.
Comment · 4 years ago
Disclosure: I work at MosaicML
Yeah, I strongly agree. While Nvidia is working on better hardware (and they're doing a great job at it!), we believe that better training methods should be a big source of efficiency. We've released a new PyTorch library for efficient training at http://github.com/mosaicml/composer.
Our combinations of methods can train CV models ~4x faster to the same accuracy on CV tasks, and ~2x faster to the same perplexity/GLUE score on NLP tasks!
Comment · 5 years ago
Instagram is down for me (located in the midwest). Reports "5xx server error"
Comment · 6 years ago
What do you think about the train test discrepancy? ie. will practitioners have to fine-tune Nubia's models on their training dataset in order to evaluate on their test dataset?
I know the authors from the blog post quite well. Say what you will about the firm, but one of the authors have been investing in machine learning since 2016, and another has a PhD in CS (including a SIGCOMM test of time award!)
I come from a strong ML background (multiple publications, PhD dropout), I would say that the canon is actually quite good.