pantelisk
Joined 7 years ago
Joined 7 years ago
Models like JEV fall in the golden middle. Somewhat cheap, somewhat fast, somewhat general.
Many people have replied saying that narrow classifiers (eg bert) are better, and they are better in many ways (essentially free and faster). But... the real world is messy, in my experience it's actually very hard to make a really good classifier that will work across a specific niche domain especially when there is very fuzzy input. And the most interesting real world scenarios are nuanced and overtime there will be edge cases discovered where it fails and that will require retraining and re-evaluation etc etc. It can becomes a full project on its own that eventually collapses into a game of whackamole (improved in some direction but regressed elsewhere). Things like JEV (or similar models) provide ease of mind, just off load the complexity to it and move on to the next challenge type of thing.
But even if others surpass them and make better solutions, the fact that nobody was able to see it before typesafe is a testament of what they might be able to come up with next.
I sound like a fanboy but I swear I 'm unaffiliated with typesafe. I was building my own version of this way before they announced JEV (mine was ALE and it was mentioned here on HN for a bit), in use for VR gaming (so one can give commands to NPCs with voice and supports multiple commands in sequence in a single pass), but I missed the "killer usecase" of being a new primitive, like everyone else.
TLDR: There's a lot of value in thinking ahead and seeing the future. The clones are nice and exciting but they give me "I could have built this first, yes but you didn't" vibes. I hope they manage to keep it up and push the space forward again
It happens more around things related to vibecoding, it seems that influencer culture, empowered by this new tooling is starting to distort tech communities.
More and more of this will be happening. Before AI coding - the fact that something like photopea or pixelr existed, meant that somebody had to commit years of focused work to even reach to the same level of quality before starting to provide value and attract users. That alone made copying a losing proposition, or at least it raised the bar as it meant one had to be a truly exceptional and dedicated builder.
Nowadays it can happen in an evening, so everything successful will get copied and attacked and attempted to be displaced by noise and hype on certain internet circles alone. Like the cheap ridiculous clones of popular ios games and apps of the past, except now on an industrial scale!
I guess this is the new world we are entering, but can we at least keep the astroturfing and bad faith behavior away damnit?
But the discourse is dominated by paper clip experiment discussions and not let's say by the fact that new grads have an unprecedented difficult time getting jobs. Unsurprisingly one of those is a sexy hypothetical beneficial to power and the other one is not.
Multiple problems can be important, pointing a different one out doesn't invalid or take away from another one.
In theory native apps have a higher ceiling for long processing tasks, since they can offload buffers on the disk and reuse - versus having to fit everything in browser memory.
This is a fully local voice AI pet (ASR + LLM + TTS) that runs entirely on-device on consumer hardware.
It uses:
- Optimized qwen-3-asr which has been converted for voice streaming (will open source this).
- Quantized gemma4 models with custom megakernel inferrence + speculative decoding as the brain (I have a finetuned version for specific scenarios but gemma empirically worked better as generalzed)
- Pocket-tts with added vector embeddings for emotion, optimized for CPU inf (https://pantel.is/projects/pocket-tts-raven/?b=1).
- Threejs for the rendering of the terrarium/jar and the 2 sample game demos that come with it
The thing I wanted to test was whether an AI character could feel like something other than a chatbot.
The dog sleeps, gets bored, asks for things. He wanders around, reacts when messed with, etc.
Or let him "out of the jar" to play games with you. Instead of just talking to an LLM about a world, you can say things like “go over there,” "pick that up," “follow me,” or “check what’s behind that,” etc, and the character can actually act on it.
The download is admittedly pretty chunky 9GB because all the models are bundled with it, but once completed it never contacts or sends any data outside again.
If self driving is red means stop, green means go, and stay in your lane - then it would work great, but having to actually think and test which maneuver is optimal for a given situation while weighting safety, road rules, random unexpected actions and getting to your destination, I think it's a much bigger problem. A bigger model specifically trained on that maybe would do great, but then the output is not the constraint anymore.
But I haven't tried the model, so I 'm just ballparking and could be very wrong.
In the sidelines buiding open-source:
- https://audiomass.co (a full-blown audio editor in just 60kb of frontend js) ::: - https://pantel.is/projects/css3d/ (an old timey 3d adventure rendered entirely in CSS)