HighFreqAsuka

Joined 3 years ago

Karma
147
Submissions
25
Member since
Jul 1
https://twitter.com/HighFreqAsuka
View on Hacker News

Recent submissions

Comment · 9 months ago
Comment · 1 year ago
Fruition is my entry recommendation. Every bar they make is good. Then Castronova, Goodnow Farms, Askinosie, Soma, and Dick Taylor. A good heuristic for evaluating a new brand is if the package tells you where the beans are from and if the ingredients list is “cocoa beans, sugar”.

EDIT: I realize you asked about bars not brands, but I’m in transit and brands was easier than individual bars. I’m a huge fan of the Askinosie orange bar in particular.

Comment · 1 year ago
> Here’s what we’ve found out: It’s not about the cocoa-beans, but about the way they are treated during the manufacturing process.

I eat a lot of high end single origin chocolate bars, and I simply don’t believe this. Two bars from the same brand at the same percentage of cocoa content using different beans taste completely different. In exactly the same way as wine or coffee. It’s one of the most interesting parts of eating good chocolate. I just don’t believe this approach will ever replace my chocolate consumption, but may have a shot at the larger market of bad chocolate bars.

Comment · 2 years ago
We've collectively failed at this problem as a society.

We've 1. made it extremely difficult, even illegal, to build more denser housing. 2. devalued the status of electricians, plumbers, and carpenters leading to a shortage of people we need to build more homes. 3. made it much too easy to get very large mortgage loans, incentivizing people to leverage themselves much more than they should to purchase homes. Thus bidding up the price of homes as otherwise financially smart people are forced to play the game as well. 4. built software to collectively price fix rents, favoring higher rents over maximum occupancy.

All of this has turned housing into an asset class, in which a significant fraction of the average American's net worth is invested, and has led to huge inflows of investor money. The incentives to not fix any of this are very strong.

Comment · 2 years ago
Did you not read the word “potentially”? Topological spaces are a more general case of spaces that contain the discrete case as a subset.
Comment · 2 years ago
By having nearly no volume to begin with. Many US stocks are listed across many of the ~13 US exchanges, so what you're describing is already the status quo. According to RegNMS regulations, traders cannot trade through protected quotes, and so trading firms already have to be aware of the prices on all US exchanges.

But LSTE has so little volume, that you frankly forget they exist most of the time.

Comment · 2 years ago
The point of that comment doesn't have anything to do with how ResNets actually work. You missed the actual point.

> We don’t actually know why resnets work so well.

Yes actually we do. We know, from the literature, that very deep neural networks suffered from vanishing gradients in their early layers in the same way traditional RNNs did. We know that was the motivation for introducing skip connections which gives us a hypothesis we can test. We can measure, using the test I described, the differences in the size of gradients in the early layers with and without skip connections. We can do this across many different problems for additional statistical power. We can analyze the linear case and see that the repeated matmults should lead to small gradients if their singular values are small. To ignore all of this and say that well we don't have a general proof that satisfies a mathematician so i guess we just don't know is silly.

Comment · 2 years ago
Yes, I have a very good point in fact. But the above comment purposely chooses not to argue with it, because it's easier to ignore it entirely and argue something else.
Comment · 2 years ago
Empirically yes, I can consider a very deep fully-connected network, measure the gradients in each layer with and without skip connections, and compare. I can do this across multiple seeds and run a statistical test on the deltas.
Comment · 2 years ago
No, there are many very mathematically inclined deep learning researchers. It's an empirical science because the mathematical tools we possess are not sufficient to describe the phenomena we observe and make predictions under one unified theory. Being an empirical science does not mean that the field is a "wild west". Deep learning models are subjectable to repeatable controlled experiments, from which you can improve your understanding of what will happen in most cases. Good practitioners know this.
Comment · 2 years ago
Just read the section on ResNets (Section 1.5) and tell me if you think that's the best way to explain ResNets to literally anyone. Tell me if, from that description, you take away that the reason skip connections improve performance is that they improve gradient flow in very deep networks.
Comment · 2 years ago
I agree with that, I think UDL uses the necessary amount of math to communicate the ideas correctly. That is obviously a good thing. What it does not do is pretend to be presenting a mathematical theory of deep learning. Basically UDL is exactly how I think current textbooks should be presented.
Comment · 2 years ago
Comment · 2 years ago
Looks like you left the submissions instructions for AISTATS on the last page of the PDF. Don't know if that was intentional but I'm guessing it wasn't.
Comment · 2 years ago
> however, it was not truly "independent",

Of course I don't mean to imply they operate in a vacuum. They can obviously see competitors raising their prices. I just mean to say they don't get into a room and actively decide on a price.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton