CubsFan1060

Any chance you’d mind sharing your list?

At what point is it no longer being a woodworker? Ai does the design and the modeling work. A robot actually does the cutting.

Isn’t this closer to being an architect or a designer now?

Interesting. Got some examples of the pharmacies?

I think that's only on the enterprise plans? So no real protection for those of us using open router personally? Or did I miss other protections somewhere?

So far it was just "investigating". From the logs, my best guess is they sent all the requests at approximately the same time, and whatever limiting they do doesn't react fast enough.

I get it, the API key was my responsibility, but, setting the dollar limit is exactly the guard they suggest against that.

Another thing to be aware of -- apparently their billing limits don't work. Somehow someone was able to use my key from Singapore. It had a $10 daily limit and they were able to spend $100. Not only that, it got me blocked from all models for the frontier labs.

On top of that, near as I can tell, there are no protections for your API key. No restrictions by country, IP, etc...

I think you are trying to argue that you can limit the open models.

If China is ok with open models being open... they will be. An attacker isn't going to be deterred by a US law saying they can't use them.

I guess my point is that if China is ok with open models, then, the attackers will have them regardless of any laws in other countries. Restricting them, in that case, doesn't seem to accomplish much?

15,000 database connections seems like a lot. Is that a scale Postgres supports very well?

What does the layout in click house look like? Do the input logs need to have a very defined structure?

What kind of hardware/price does it take to run those?

I think that's true until it isn't, which may end up being the problem. Fable/Mythos doesn't fall under the ZDR agreements with Anthropic. And I'm curious if others will follow suit.

Knowing very little about how to run these, how close are we to medium or larger businesses starting to buy hardware to run models like this to keep the models local?

It’s expensive, and not as capable as the frontier models, but would have some pretty big benefits around privacy and agency.

Though of course Apple's rules aren't always consistent, I have 2 separate apps currently on my phone that can/are running this (Google's Edge Gallery and Locally AI)