cfn

I need to have the answers faster it is that simple, I don't want the users to wait for more than a few seconds.

I will check it out! I am using that exact model and it is very verbose when compared with the latest Muse, for example, increasing the completion time a bit too much.

Sorry, can't say just yet but nothing as dramatic as what was guessed below :)

It's not launched yet and 2k isn't a hard requirement but faster inference of relatively simple prompts make a big difference for us. Cerebras also failed because it has very small context window.

I am using opencode and Inception.ai (the fastest so far)

I tried Cerebras this week for my project and their 27b model at 2000tks would be perfect for it. Unfortunately it doesn't do the 2k tokens per second which is what I am looking for.

For me it is line space, I keep reading the same line over and over (desktop Macos).

The comments here are confusing risk with health consequences. Whereas working in construction or with heavy machinery poses much higher risks than sitting at a desk for 30 years the results may be just as bad in both cases.

Just like a construction worker should observe H&S to minimize accidents, the office worker should get up regularly and exercise but, again in both cases, ignorance, carelessness or a heavy handed boss are rampant.

I like that so many of the winners attended the ceremony, one should never take yourself too seriously.

I have had instances where the app runs fine on the simulator but crashes on the device. This might solve that.

Here in Portugal we already have many products (specially fruit) from Brazil, Peru and other South American countries. Will the prices go down as they won't have to pay EU tariffs?

Or 4 thousand for the NVIDIA RTX A6000 which also runs the 120b just fine (quantized).

If you are over 50 and live in Southern Europe this used to be a ver common way to spend an afternoon. Maybe add a newspaper and definitely a cigarette to go with your coofee. Very relaxing.

Two hundred million would be really good compared with 35 for a 10-12 car ferry. We have had larger ferries in the past which would do the whole archipelago and would take over 100 cars.