alecco
Joined 18 years ago
Joined 18 years ago
And Google came up with the Transformer architecture (2017 "Attention is all you need"). The Attention mechanism they based it on is from Bahdanau, Cho, and Bengio (2014, ICLR 2015). And there were many other self-attention variants by 2017. It was an amazing paper but let's not twist the story and give proper credit.
And not one of the people in that paper are still at Google, AFAIK.
Google has more compute, more data, and had the best 2 labs. And it seems they squandered it all. I'd blame their McKinsey CEO, the board, and management in general. It's a shadow of what it used to be. And it's a shame.
I did not have this one on my 2026 bingo card.
You could argue the BSL is anti-business. But IMHO even that one is only a reaction to abuse. Database companies investing millions in research, development, and maintenance for some trillion dollar corporation to take it and make billions off it without giving back a single penny.
It also prefer to give my money to the pro-social companies giving away their open models (they cost many millions) instead of opportunists who don't give much back.
And EU leadership completely destroyed Europe's future by betting on depending on US and Chinese models. https://pleias.ai/blog/fable-eu
HN search shows 21 comments in the past month from simonw+pelican: https://hn.algolia.com/?dateRange=pastMonth&page=0&prefix=tr...
You can choose to look the other way but 3 comments out of 21, where 2 were kind of the same one on the same day, and 27 days ago... But you say "repeatedly crosses into harassment" as if I'm a troll chasing him around.
I was caring about the quality of this site with my 18 year old account... Unbelievable.
But as you bless him, I give up. It's your site. Quite a bummer after I defended you many times over the years, though. I remember in the beginning your interventions were not generally welcome.
Edit:
His comment is now 12th in this thread and there are comments saying his pelican SVG test is pointless. At least there's some sanity with other users. Or are they harassing him, too?
Sadly his other comment on Hy3 thread is still the top comment. And of course it also has a link to his site. https://news.ycombinator.com/item?id=48848950