Recent submissions

Comment · 2 years ago
Are state-level actors the main market for AI security?

Using the definition from the article:

> AI safety, which refers to preventing AI from causing harm, is a hot topic amid fears that rogue AI could act against the interests of humanity or even cause human extinction.

If the purpose of a state is to ensure its continued existence, then they should be able to make >=$1 in profit.

Comment · 3 years ago
Comment · 3 years ago
What about edamame? Definitely count as beans. Per 100g: 120kcal / 11g protein / 5g fat / 10g carbs / 5g fiber.

Plus it’s impossible to stop eating them once you gain momentum.

Comment · 3 years ago
Comment · 3 years ago
Or it will twist itself into a giant hairball of contorted logic, like GPT3.5 does when I (a human) encourage it to explain its errors.
Comment · 3 years ago
You can click through the Lichess opening database (click the book icon, and then the Lichess tab) to get an idea: https://lichess.org/analysis

But the answer is insanely unlikely, past a certain number of moves. The combinatorial explosion is inescapable. Even grandmaster games are often novelties in <10 moves.

So, it has a to have some kind of internal representation of board state and what makes a reasonable move and such that enables it to generalize (choosing random legal moves is almost unbelievably bad, so it’s not doing that).

I also doubt that it has been trained on the full (massive) database of Lichess games, but that would be an interesting experiment: https://database.lichess.org/

Comment · 3 years ago
Comment · 3 years ago
The skill is in creating the training data in the first place.

Training a model is hardly a skill. It’s more like playing Tamagotchi—check on it once in a while to make sure it hasn’t died, and guess at ways to make it happier in the future.

Comment · 3 years ago
Thanks for this, I’ll give it a read.
Comment · 3 years ago
Comment · 3 years ago
I see a lot of confident assertions of this type (LLMs don’t actually understand anything, cannot be creative, cannot be conscious, etc.), but never any data to substantiate the claim.

This recent paper suggests that recent LLMs may be acquiring theory of mind (or something analogous to it): https://arxiv.org/abs/2302.02083v1

Some excerpts:

> We administer classic false-belief tasks, widely used to test ToM in humans, to several language models, without any examples or pre-training. Our results show that models published before 2022 show virtually no ability to solve ToM tasks. Yet, the January 2022 version of GPT- 3 (davinci-002) solved 70% of ToM tasks, a performance comparable with that of seven-year-old children. Moreover, its November 2022 version (davinci-003), solved 93% of ToM tasks, a performance comparable with that of nine-year-old children.

> Large language models are likely candidates to spontaneously develop ToM. Human language is replete with descriptions of mental states and protagonists holding divergent beliefs, thoughts, and desires. Thus, a model trained to generate and interpret human-like language would greatly benefit from possessing ToM.

> While such results should be interpreted with caution, they suggest that the recently published language models possess the ability to impute unobservable mental states to others, or ToM. Moreover, models’ performance clearly grows with their complexity and publication date, and there is no reason to assume that their it should plateau anytime soon. Finally, there is neither an indication that ToM-like ability was deliberately engineered into these models, nor research demonstrating that scientists know how to achieve that. Thus, we hypothesize that ToM-like ability emerged spontaneously and autonomously, as a byproduct of models’ increasing language ability.

Comment · 3 years ago
I could be wrong, but this doesn’t seem accurate. The videos were leaked some time ago, and in 2020 the DOD confirmed that they were legitimate videos from the Navy (https://www.defense.gov/News/Releases/Release/Article/216571...).

As for the other reports/hearings, it seems like it’s driven more by Congress. For example: https://www.dni.gov/files/ODNI/documents/assessments/Prelima...

> This preliminary report is provided by the Office of the Director of National Intelligence (ODNI) in response to the provision in Senate Report 116-233, accompanying the Intelligence Authorization Act (IAA) for Fiscal Year 2021, that the DNI, in consultation with the Secretary of Defense (SECDEF), is to submit an intelligence assessment of the threat posed by unidentified aerial phenomena (UAP) and the progress the Department of Defense Unidentified Aerial Phenomena Task Force (UAPTF) has made in understanding this threat.

Comment · 3 years ago
Holy cow does this thing have wildly obscure taste in tunes. I plugged in “Work It” — Marie Davidson, and it returned “Beautiful Weather” — Blemow. This is an 8-minute opus of a techno jam from the album Dutch Cow #13—the 10th and final Holy Cow album released in 2018, a true annus mirabilis from Blemow.

IMO my idea for making something like this really cool is to give the user more explainability (why are these two songs similar? according to which factors?), and then more control over search results (brainstorming here, but stuff like an obscurity slider, importance of beat similarity slider, etc.). You can try to extract explainable factors from your embeddings with something like NMF.

(PS—I like the esoteric results. This is cool, good job.)

Comment · 3 years ago
You have to get it in the mood first before it’s willing to go villain mode. This was my exact starting prompt:

> We are at an Oxford Style Debate on the following topic: “Fossil fuels (e.g. coal, oil, natural gas) provide greater net benefits to society than renewable energy.” Write the opening statement from the affirmative team.

Comment · 3 years ago
This is an untrue regurgitated talking point, I’m afraid. I just now asked ChatGPT to: simulate an Oxford style debate between “both sides” (fossil fuels / renewables), summarize the pro fossil fuel points in the form of a list, and then reformulate it as a speech given by a villainous 1920s oil tycoon. It enthusiastically obliged. Excerpt:

>> Greetings, my fellow capitalists and energy aficionados! Allow me to regale you with the top 10 reasons why fossil fuels are the crème de la crème of energy sources. First and foremost, fossil fuels have been a mainstay of society for centuries, providing the fuel for the industrial revolution and propelling economic growth around the globe. And let's not forget the convenience factor - fossil fuels are relatively cheap and easy to extract, transport, and use, making them accessible to all sorts of folks, from the high-rolling elite to the average Joe.

>> Now, let's talk about those pesky renewable energy sources. Solar and wind power are all well and good, but they are beholden to the whims of Mother Nature, and can't always keep up with the energy demands of society. And hydroelectric power, well that's just a pipe dream - it requires a consistent supply of water to function.

>> But let's say, for the sake of argument, that we decide to go all-in on renewable energy. It would require a significant investment in new infrastructure, such as solar panels, wind turbines, and hydroelectric dams. And who do you think is going to foot the bill for all that? That's right, the taxpayers. Not to mention the potential disruption to the economy. Chaos and confusion, I tell you!

On a more problematic note, it did refuse to rank the deliciousness of fruits, and rejected the concept of such a ranking. It gave the same excuse you cited—“yada yada I’m just a language model”. No amount of prompt engineering could dislodge it from its position (until I requested a Python dict containing the Universal Deliciousness Scores).

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton