slashcom

There’s lots of work on distillation, smaller models, approximations, etc. People already have simpler forms of these running on smartphones. Models seem to be growing faster than we can make them small though :D

A DGX-2 will do just fine.

Quite a few of my colleagues came back Monday the 27th. I imagine many stay longer since the trip is onerous.

fp16 saves a lot of memory and is worth doing. I've not had trouble fine tuning all these models with fp16.

Zipf’s law

From the paper:

"$50,000 was divided among the human participants based on their performance to incentivize them to play their best. Each player was guaranteed a minimum of $0.40 per hand for participating, but this could increase to as much as $1.60 per hand based on performance."

So the humans weren't betting their own money, but they still made more money if they won.

That should tell you how grad students are paid.

I mean, that’s the thing though. Undergrad in state tuition plus R&B for NCSU and UTexas (programs I got in state tuition for) is at 9k and 10k per year with 5% interest for undergraduate, and more like 6-8% for MS students.

You can be employed in a high paying sector like tech after going to an in-state engineering school, and still l end up with $2k tacked on in your first year of employment. So then what is more rational: pay off the loan as fast as possible, or build up an emergency fund with a generous 2% ROI.

That is the actual plot of the SheWork episode in Broad City.

Yann LeCun did not, otherwise he’d be a coauthor. As it is, this was a collaboration between NYU and Facebook AI Research, with multiple authors working at both institutions.

I don’t know man, 20% of your annual income would be seen as a sizeable fine. That’s 20% of their yearly profits, and it wipes out most of their earnings for Q1.