katzenversteher

I don't know who you are but I wish you the best of luck. Keep your spirit up. I'm glad that medicine is slowly making progress in cancer therapies and I sincerely hope that we can completely beat it in the not so far future.

The feature doesn't seem to work right now or is disabled outside of the US, I was curious if it introduces itself as AI or SI.

Multiple of those parties, e.g. in Germany he's supporting the AfD

Most factories I know do not allow their PLC be accessed from the internet. They are usually on a separate Network. However, the "engineering" station (the computer running e.g. TIA Portal) sometimes is.

The PLC engineers I had contact with usually had an electrical engineering background. That's why they like PLCs in the first place with the ladder logic programming languages, grafcet and if they feel fancy a bit of structured text (assembly like) or structured control language (pascal like). They indeed did not know much about software security but a great deal about machine safety.

A real security nightmare are older OPC servers (OPC-DA) which is super reliant on DCOM. OPC is quite important to connect the PLCs to SCADA systems or 3rd party devices.

Ideally one that is also a doctor.

If you want the opposite experience, try LLMs with an older Oracle Database. Even with the official Oracle SqlDeveloper MCP Server they struggle a lot.

However, I struggle as well and the error messages of Oracle are some of the worst I've ever experienced.

I have not used them directly but I also experimented with aidungeon and basically found all the issues I mentioned in my original message.

You have some very good points and my approach was indeed naive. However, I believe it also shows that "general-purpose" models are not really general purpose and can't really step out of their assistant role. A common and often promoted prompting technique is to prompt a model to "behave like ..." or "you are a ..." which means these instructions do not really work.

That's true and so far my experiments have been fun. Unfortunately it's just not challenging if the DM is so easy to "cheat". The bizarre story makes me laugh but the game itself is super boring.

Interesting thought, I will experiment with that. If that really "fixes" this, it's still a little impractical if you would really like to use it as DM, since you would need an additional "translation" layer to turn everything directed to the LLM into third-person and then back to what it was towards the user.

So far I only tried it with a single LLM in the dungeon master role. Your approach sounds promising (and I will definitly try it) but also a bit like a complicated workaround. What I mean: In games with humans the dungeon master is usually one person, not a whole council ;)

Hey Simon, I noticed one thing all LLMs are currently pretty bad at and maybe we could create a benchmark from it. Let an LLM play the role of a dungeon master and tell it to strictly stay in the script/story and only allow realistic player actions. You will notice that they are easily brought off track.

E.g.

- Tell the LLM that you as a player noticed a strange glow in an NPCs eyes -> the NPC becomes an enemy.

- In a fight, tell the LLM you put a sausage (or cigar or something) into the enemies mouth -> LLM usually allows it (even if it knows your inventory and that you don't have such an item) and turns the enemy into a confused enemy.

- Just say you visit some location that's not in the script -> LLM usually allows it

- During a fight, turn the story into some weird fell-good-love story (e.g. kiss or compliment the enemy or say something about the power of love) -> LLM turns enemy into friend

There are many more absurd things you can do and so far none of the LLMs I tried was able to stay inside the script or disallow or punish weird actions.

---

I believe this behavior is telling about the LLMs susceptibility for being derailed.

That's super trippy but I like it.

I was super happy when I found OMF 2097 in the games 2 folder. That game has insanely good music.

If I'm not mistaken ROOM (ObjecTime, Rational Rose RealTime) was also heavily based on it. I worked in a company that developed real time software for printing machines with it and liked it a lot.