rockinghigh

With decisions models, you don't pay for output tokens. Also this OpenAI API is multimodal.

Their marketing language is misleading. They must still use some transformer language model backbone to encode the text input (BERT or decoder-only LLM). The biggest difference is the output, instead of auto-regressively generating tokens, they produce probabilities over a bounded set of decisions (more flexible classification).

Human reviews are going away for most PRs these days. If the LLM decides the risk level of the change is low, the PR can be merged without another human in the loop. That's at least the direction many companies are taking. Only require a human judgement when necessary.

Using tools to fix your writing style or grammar is not exactly cheating.

For small models, tokenization can reach 1-10% of total inference time.

A coding agent driven by a large LLM can delegate smaller tasks to a faster model. For example searching through the codebase for references, examples, or established patterns. They are treated as tools and don't pollute the main agent's context.

Open-weight models were lagging 4 months behind OpenAI/Anthropic at the beginning of the year. They are now just 4-6 weeks behind.

The US is also falling behind Chinese manufacturing. They had to ban Chinese cars because legacy American automakers couldn't compete.

Same here, I fine tune LLMs for specific use cases. How can I trust Anthropic models not to introduce bugs to preserve their moat?

Imagine if your IDE started injecting bugs into your project just because your code looked like it implemented a competing IDE.

Consumers don't control zoning laws or risk mitigation details.

Gemini tends to be faster and the Flash and Flash Lite models outperform ChatGPT's equivalent models.

It may be a push from advertisers who want access to this format. Google Search competes for their money against the competition.

They own tons of engagement data associated with that index from being the default search engine on most devices.

Why wouldn't getting more customers the plan? Anthropic doesn't acquire companies to have a lower market share. There is clearly a consolidation and a rush to get as much of the developer market as possible.