SouravInsights

By moat I just mean something a solo dev can build/pursue that doesn't get absorbed by vLLM/SGLang in few months. I'm fairly new to this space so not trying to get too deep into kernels or hardware.

Something around inference tooling: benchmarking or eval/regression checks for quantized models or something else. Something that's useful as a standalone tool/project or to learn the space properly. Just curious where there's still some opportunities.

Sorry but I'm not sure what you are trying to communicate with this analogy?

gold standard!

Fair point but for me the kid part was never really about being offline, it was more about having no audience. I'm saying we need to go back to how we felt when we did things just for ourselves, with no nody watching. And I feel kids today need adults to leave some room for it.

Not yet but the suggestion below is the strongest signal. Plus "typos" as someone mentioned earlier in this thread, could be a signal to authenticity lol

You have actually observed something interesting here because authenticity is how we decide who to trust. Effort and voice used to be cheap signals of a real person now llms can fake pretty much both, so I'm having to work harder to know who is on the other end.

Because authenticity matters today even more so. A simple observation, imagine this post was purely generated/optimized by llm, it wouldn't have gotten people discussing about it. Cause it's easy for smart people to quickly notice the slop and the tone. You definitely have noticed that llms don't seem to have strong opinions, it always tries to be politically correct and that's easy to spot. But having strong opinions itself isn't necessarily a sign of authenticity though. As "itsalwaysgood" put it, authenticity forces people to think through what they want to communicate so it works as a friction for good writing and drives genuine engagement. I mean who would love the idea of talking/arguing with a bot.

When I'm talking to a person irl or even chatting online I would find it very weird if the the person is always conforming to me and rarely brings up a new genuine insight or a contrary thought to add to the discussion. I'm not looking for a debate always though, sometimes just listening to someone is enough. But I hope you understand what I mean here.

this is such a spicy thought worth overthinking lol

No, I think I don't need to do such cheap stunts to back the authenticity of this post.

I guess it's much of a bad habbit/influence of using auto-suggestions in my mobile keyboard than a typo I agree..

Yeah I agree that direct experience is definitely a pretty good counterweight. You can definitely discover something completely on your own and genuinely like it, without ever seeing anyone else validate it.

But yeah I wasn't stressing much on this specific idea/notion in my post though.