viergroupie
Joined 19 years ago
Joined 19 years ago
Hidden in the article is a sneaky mismatch of definitions. Isn't it a tautology to argue that intelligence is singular by using a narrower meaning?
"Neural networks" are just the composition of several nonlinear regressions. There's nothing particularly "neural" about them.
Here's a typical 3-layer network:
f(x,Wh,Wo) = tanh(Wo * tanh(Wh * X))
Wh, and Wo are the hidden and output weight matrices respectively. Fix some loss function (ie, L(x,Wh,Wo,y) = || f(x,Wh,Wo) - y||^2), get the gradient of this function, and a take step down the gradient. There's your learning rule.
Now, I understand the desire for flexibility/modularity, but (1) what's the sense of trying to house supervised and unsupervised methods in the same hierarchy? and (2) what could possibly justify Connection and Weight objects?
This is his criterion for a research position? Understanding of the unsolved problems in a domain? "Irrelevant."
Mathematical sophistication needed to abstractly model complicated-seeming scenarios? "A dime a dozen."
Know the decorator pattern? "omg, you're hired!"
As for what functional language you want to end up using...well, it depends on your goals.
I'm personally partial to the family of languages which use ML-style type systems, which include OCaml, F#, and Haskell.
The core of F# and OCaml are very similar. F# has better libraries whereas OCaml has both a more powerful type system and more powerful module system.
Haskell is less straight forward than OCaml and F# and has many more esoteric features you need to learn before being considered an expert. Nonetheless, many have found the process of learning to be a mind-expanding process. Also, the Haskell community is much larger and more vibrant than what you'll find with any other statically typed functional language.
edit: Relevant conferences in computational neuroscience -
We admire your frugality.
- Why does God allow evil?
- Does P = NP?
- How does it feel to be so gosh darn awesome?
Uhhh..isn't tight regulation of the economy what fucked up their job markets in the first place?
If you lack fundamentals, skip the sources and look for the people. Find a good teacher and take their class. This will probably entail an intense week of course shopping at a local school. Friendly fellow students can be a huge boon, at least for me, since I solidify concepts best in conversations with peers.
If you, for some reason, absolutely cannot take a class in person, I would encourage you to find a study partner and watch online lectures together. I really like MIT's Linear Algebra and Differential Equations videos (http://ocw.mit.edu/OcwWeb/web/courses/av/index.htm#Mathemati...), but but I don't know if those are at your level.
It could also be a mismatch between someone's personality and the sort of math kids get taught. I did poorly in most of my math classes in high school and college. After failing a few classes, decided I was hopelessly "bad at math", and left the topic alone. A few years I took an abstract algebra class on a lark and really enjoyed it. In hindsight, I did poorly in my earlier math classes because I was undisciplined and really disliked memorizing disconnected tricks and formulas. Abstract algebra, on the other hand, was more elegant, conceptual and fun to learn. Doing well in one class punctured my myth of inability and gave me the confidence to properly learn linear algebra (and take some other interesting classes).