covertcorvid
Joined 1 year ago
Karma
9
Submissions
4
Member since
May 18
Recent submissions
Comment · 1 month ago
Comment · 1 month ago
"alignment researchers tend to be in house philosophers on staff" - this is definitely not true. Go to any alignment lab like Redwood research and check what their scientists studied on LinkedIn, 75%+ of the time it's math or CS.
I attend a top 10 Canadian university and personally know at least 4 tenured CS professors out of the 7 I've asked who are deeply concerned about catastrophic AI risks from loss of control.
Of course not 100% of the field agrees, but a survey of nearly 3,000 AI scientists who have published in top AI venues found that "depending on how we asked, between 38% and 51% of respondents gave at least a 10% chance to advanced AI leading to outcomes as bad as human extinction", let alone loss-of-control risks less severe than extinction. (https://www.jair.org/index.php/jair/article/view/19087).
Not to mention Geoffrey Hinton, a Nobel prize winner, Bengio, the world's most cited scientist, and scientists like Stephen Hawking and Alan Turing have all voiced series concerns about loss of control of artificial intelligence.
Comment · 1 year ago
Hey! Thanks for making such a useful app. Saved me hundreds of hours.
Comment · 1 year ago
RemNote (https://www.remnote.com/) solves the problems people are mentioning about
1) The time it takes to make cards. RemNote allows you to take Notion-style block notes and quickly turn bullet points into flashcards using symbols. For example, you might be in class and make a bullet point in the format
- The quick brown fox jumps over >> the lazy dog
which you can later review as a flashcard that is automatically separated front/back by the >>.
2) The old and unintuitive UI - again, basically just Notion with flashcards. You can easily view all your notes in a bullet hierarchy and then switch over to SR flashcard practice. Even has rich code blocks, image occlusion, tables etc. A much better implementation of Anki's notes/cards metaphor in my opinion.
I am not sponsored by RemNote, just a university student who has bounced off Anki and really likes the app.
Two of the professors who voiced concerns specifically study AI/ML.
Yes, Hawking and Turing didn't know modern GenAI, but Turing specifically laid much of the theoretical groundwork for AI systems today. Even ignoring these two, my argument still stands. Tonnes, maybe even a majority of reputable people in ML/AI take loss of control seriously, according to both large scale surveys, 2/3 of the field's "godfathers" and my personal experience with tenured ML researchers.