Reading this article brought me no closer to understanding why people use these. From day one you could give any LLM any context you wanted, that's the whole point after all.
The actual next stage of LLM development will be giving the user the ability to select/deselect what training data to include otherwise there is a limit of at most a few pages of context you can provide.
Custom GPTs are trying to pretend thats what they are doing but it's not going to work.
Like you can't upload a novel and say, "speak to me as if you are this character" because the LLM can't ignore it's training data entirely and the context you give it gets drowned out quickly.
The actual next stage of LLM development will be giving the user the ability to select/deselect what training data to include otherwise there is a limit of at most a few pages of context you can provide.
Custom GPTs are trying to pretend thats what they are doing but it's not going to work.
Like you can't upload a novel and say, "speak to me as if you are this character" because the LLM can't ignore it's training data entirely and the context you give it gets drowned out quickly.