kaffeinecoma
Joined 17 years ago
Karma
1,474
Submissions
295
Member since
May 12
Recent submissions
Comment · 8 years ago
Wow, this is really a great resource. I wish it had been available a few years back when I took the free online version of CS231n. The hardest part (for me, anyway) was the long-forgotten Calculus needed for backprop. Especially as applied to matrices. I struggled at the time to find accessible explanations of many of the matrix operations, and you seem to have it all laid out here. Thank you.
Comment · 8 years ago
Adding my own anecdote, there seems to be some kind of problem with high I/O loads on High Sierra.
One of my projects involves indexing thousands of URLs. During development I use a large (80GB+) local cache of a few million files. Running the cache code (~100 lines of simple Golang) totally brings my iMac (3.8GHz Core i5, 24GB) to its knees. CPU shows as mostly idle & memory pressure is low, yet the machine can't redraw windows properly after about 5GB of I/O to local SSD.
Completely frustrating. I moved the code over to an older (2010!) Mac running Ubuntu and it handles it without breaking a sweat.
Comment · 10 years ago
Paranoid patient question: when one goes for an MRI, is there any kind of scan for foreign metal objects? I'm sure they ask if you have any devices implanted, but do they actually check for the unexpected? What would happen if you had one of these little bristles and you didn't know it?
Comment · 10 years ago
I think the concern is more that a sentience that is many orders of magnitude more intelligent than humans simply won't care about us. How do you feel about ants?
Comment · 10 years ago
I like to build something that I've programmed before in another language. Maybe this seems redundant. But if you have the problem fresh in your mind, it leads to asking the kinds of (Googleable) questions that get you very quickly to a base-level understanding of the new language. It also sheds light on the areas where the language is better/worse at specific things than the lang you are used to working with.
Comment · 10 years ago
A month ago I was in the same place- I would start reading a short blog posting on RNNs/ConvNets/etc., and within 2-3 paragraphs my eyes would glaze over from the math and other foreign terminology. Frustrating. To try and fix this I am "auditing" the Stanford course on ConvNets: http://cs231n.stanford.edu/syllabus.html
I'm about 2/3 done with the homeworks, and I understand this stuff now. I'll never be a data scientist, but I know enough to implement these networks on my own, and to understand blog posts like this. It's a lot of work for one course, much more than I remember from my own undergrad years. I had to revisit Calculus & Linear Algebra too. But if you're genuinely interested in this stuff you can pick it up.
Comment · 10 years ago
My guess is he's referring to the large number of romance loanwords that came into the English language as a result of the Norman Invasion.
Comment · 10 years ago
I'm really looking forward to no longer having to figure out which project I have to axe to keep my "small" plan under the 10 repo maximum. That was always annoying.
Comment · 10 years ago
I was just starting the 3rd lecture. A real shame.
Comment · 10 years ago
A "kind of" compression using polygons: https://rogeralsing.com/2008/12/07/genetic-programming-evolu...
I believe it was discussed here a few years back.
Comment · 10 years ago
No need to apologize- I learned SO much from your blog, thank you. I didn't realize the course was online
(https://www.youtube.com/watch?v=NfnWJUyUJYU). Also, looks like there's a subreddit for it as well:
https://www.reddit.com/r/cs231n
It's really wonderful that all of this is freely available, thank you.
Comment · 10 years ago
People are knocking this guy for not being an expert and maybe getting some details wrong. Maybe it's a little bit like watching a non-programmer stumble their way through a blog post about learning to program- experienced programmers may cringe a bit.
But I really appreciate these kinds of write-ups: he declares his non-expertise up-front, and then proceeds to document his understanding as he goes along. There's something useful about this kind of blog post for non-experts.
I'm working my way through Karpathy's writeup on RNNs (http://karpathy.github.io/2015/05/21/rnn-effectiveness). I've mechanically translated his Python to Go, and even managed to make it work. But I still don't entirely understand the math behind it. Now obviously Karpathy IS an expert, but despite his extremely well-written blog post, a lot of it is still somewhat impenetrable to me ("gradient descent"? I took Linear Algebra oh, about 25 years ago). So sometimes it's nice to see other people who are a bit bewildered by things like tanh(), yet still press on and try to understand the overall process.
And FWIW I had the same reaction as the author when I started toying around with neural nets- it's shocking how small the hidden layer can be and still do useful stuff. It seems like magic, and sometimes you have to run through it step-by-step to understand it.
Comment · 10 years ago
My comment wasn't meant to knock C++; it was to point out that Linus' opposition to the language is well-documented, and an official git-rewrite in C++ is very unlikely.
Comment · 10 years ago
Re-writing Git in C++? Can't tell if you're trolling or not. http://harmful.cat-v.org/software/c++/linus
Comment · 10 years ago
I doubt it. I did Java for over a decade, but jumped at the opportunity to use Go with its statically compiled binaries. The JVM is great, but being tied to it is kind of a hassle. Being able to hand a small binary to someone and say "here, run this" with no worry about dependencies- it's a beautiful thing.
To contact me: my email is armhold at gmail com. Please mention HN if you do (too much recruiter spam, but HN contacts always welcome.)