throwaway1851

I’ve had opiates for wisdom tooth extraction and a couple of relatively minor but very painful injuries. I was very glad to have them. They made the experiences much more bearable. I did not experience any addiction issues, and I’m glad that my access to these medications was not limited due to some people’s inability to handle them.

I really don’t think forcing needless suffering on everyone is the answer to this problem.

If you've reviewed the facts in this case, and that's what you took from it, then I seriously question your reading comprehension ability.

And, with that, we’re back to pre-LLM chatbot design: intent classification, entity extraction, business logic, return a result. Only the whole process rests on a more rickety foundation. It’s also bloated and slow, querying an LLM over and over for these things. I’m starting to see some parallels to modern JavaScript and SPAs. ;-)

Bard hasn’t been using Google’s best language models. I believe it just got an upgrade, however, and I’m now getting output that is significantly more coherent and useful than ChatGPT’s. It’s also a helluva lot faster, though that could owe to the limited access.

That’s only going to get you so far. Sparsely represented subjects have have an actual reality you’re trying to model. So while yes, you can generate synthetic data to interpolate between the points that have already been sampled, whether those interpolated points have anything to do with the underlying reality is a matter of chance. If you really try to drill down the existing tools into a specialized problem area, it becomes very clear that they lack a sufficiently informed model of the subject to be useful. That’s why I’ve found that ChatGPT is great at the beginning of a project and increasingly irrelevant as you approach the core technical challenges of the project.

Especially weird since SFO is not in San Francisco.

OpenAI’s fear-mongering efforts have been really transparent. As an example, in the ABC News piece, one of their employees discusses asking GPT to help build a bomb. Your employees using words like “bomb” on television is not something that happens by accident.

OpenAI explicitly disclaims ownership interest in the model outputs. A user who both generates outputs from OpenAI AND uses it to train a “foundational” model that competes with OpenAI could owe contract damages. Other parties? I simply don’t see it.

I think a review of the state of frontend tooling will show that efficiency with respect to developer hours is not a widely shared priority. I only say this with only 50% intention of starting a flame war.

> It gets basic facts wrong and often times misunderstands what I'm trying to ask it.

In haven’t tried Bard, but I’ve tried ChatGPT extensively and this sounds like a very good description of it.

Any news on whether they're pursuing downstream weights? That's a really interesting question for me - if you started at the LLaMA weights and arrived somewhere else by supplying additional training data and computation, any infringement claim would be very, very murky. I also think it would be practically difficult to prosecute such a claim because it would necessarily involve comparative questions about the consumption of unlicensed training data to generate the original weights. It would certainly make for interesting law.

It’s not a lazy refrain, it’s a serious downside of the technology. It’s tiring and stressful to supervise the work product of an assistant that is extremely capable sometimes, but a compulsive bullshitter at other times. Just as it’s tiring to supervise an “autonomous” car that often deftly navigates the road, but sometimes wants to plow into a school bus.

A concern I have about OpenAI is that, if you're using their APIs to develop an application, they can mine your data to compete with you, or even beat you to market. They can do this indirectly, by sharing information with preferred business partners. The conflict of interest, combined with the lack of robust data privacy guarantees, makes me queasy.

If serving up generic LLM APIs becomes commoditized -- and I think it will -- they will want to monetize in other ways.

OpenAI disclaims ownership interest in the model output. If a subscriber (who has a contractual relationship with OpenAI) chooses to generate outputs that could be used to train a competing model, and chooses to share those outputs with third parties, that is not prohibited by the agreement. Further, the data being shared belongs to the subscriber and can be licensed however they desire (though actually, model outputs may not be copyrightable at all). If a third party who does not have a contractual relationship with OpenAI chooses to take this data and train a competing model, they are using the data under valid license and have breached no obligation to OpenAI.