selalipop

But their comment is about 2 years out of date, and AI image gen has got exponentially better at text than when the models and LoRAs they mentioned were SOTA.

I agree we probably won't magically scale current techniques to AGI, but I also think the local maxima for creative output is going to be high enough that it changes how we approach it the way computers changed how we approach knowledge work.

That's why I focus on it at least.

I've been working on post-training models for tasks that require EQ, so it's validating to see OpenAI working towards that too.

That being said, this is very expensive.

- Input: $75.00 / 1M tokens

- Cached input: $37.50 / 1M tokens

- Output: $150.00 / 1M tokens

One of the most interesting applications of models with higher EQ is personalized content generation, but the size and cost here are at odds with that.

If you actually look into the "SEO slop", they're constantly fighting a battle with Google to keep their place.

It's all garbage so no one notices when some of it suddenly disappears off the face of the earth and gets replaced with other garbage: but for the ones making it, their revenue essentially goes to 0 overnight.

technically launched 6+ months ago, but yeah current form of it did "re-launch" 2 months ago

Making good revenue but mostly I'm just very bullish based on current revenue and willing to bootstrap

That's picking up pennies in front of a steam roller: Google is incentivized to punish you when the content is garbage, and people are disincentivized to share what you generate.

It's an entirely different game once you can generate useful content worth reading with AI. People will even pay you good money for it.

Spellbound is an instruct model to NovelAI's completion model: you enter commands which in turn dictate what happens to your character, then the AI models how others would react to you

I've experimented with 30 or models so far, my general finding is closed source models like Claude have GPT-isms, while open source models do have a little less of a default tone but their ability to understand existing worlds is directly tied to how many tokens they were trained on.

Since existing worlds are (currently) where most of the stories are set, it's worth it to use a closed source models and wrangle their issues with dialogue.

To it's credit though, Llama 3 is the first OSS model trained on enough tokens to not feel lost for most worlds, so I've started routing some traffic to it for free users

The output format the site uses is also really really hard for most models to follow without fine-tuning, but fine-tuning then causes them to pick up the vocabulary of whichever model they were fine tuned on, which is a bit unfortunate

Unfortunately Supabase charges extra for the luxury of setting that URL, and the site is wildly unprofitable right now so I'm sticking to their free offering for the time being

Privacy policy and terms of service should be visible on homepage and in the sign up dialog

The pricing page is also visible when signed in and in a story (no dedicated pricing page yet but it's in the backlog)