Frannky
Joined 1 year ago
Joined 1 year ago
For now, I think everyone is still using Anthropic and OpenAI because if you use a subscription you pay 1/40–1/50 of the API prices, and the models are good when they don’t nerf them, and they are also way cheaper than open models’ API prices.
The interesting thing will happen when they pull the plug and become economically smarter to stop using them. I regularly try alternatives to avoid being locked in and found GLM-5.3 as an orchestrator and GLM5.3 Flash + OMP and DeepSeek Flash as advisor to be able to get jobs done just fine. Space Bunny too was pretty great, which was probably MiniMax’s new model.
I think they are using an Uber like strategy but without the network effects that justify losing money for so long
Oh-my-py unlocks max capabilities at the smartest token usage, and you can change AI company and providers while still getting things done. Roles, advisor, and the ability to use Chinese models on international providers with no training and ZDR behind OpenRouter are very powerful. You can have providers and model companies competing on price, intelligence, and speed for something that's useful but with less and less moat as model progress plateaus.
I now use GLM 5.3 for slow/planning, GLM 5.3 Flash as the default task-vision model, and DeepSeek Flash 4.1 as the advisor. Providers are ordered by cheapest at the minimum TPS I want for that model. I use it not only for coding but also as a personal assistant. I can ask it things and it gets them done automatically, like opening an issue on a repo, then having another agent ship the code, run the tests, and update master after having changed the app to autoupdate on cut release.
I can also ask it to do groceries. I use Bitwarden machine secrets and a limited virtual card connected to my phone.Something else that's very powerful is asking it to launch parallel agents to do things you know don't overlap too much.
The amount of agency we're gifted with is crazy, you can now move hundreds of hours of work with one hour of input using an open-source harness and open-weight models. I can't wait for more competitors in the chip space, and to be able to buy models etched on silicon for even higher agency, speed, and independence.
They have a new shiny data center with Chinese GPUs, so hopefully they will be able to handle the demand. Their subscriptions are meh, in particular the Flash model has not that much usage. The other thing I wanted to try is Groq Qwen 3.8-27B at 450 tps to see if it's able to get work done faster.
I feel it's very important to play outside of the walled gardens, I feel they will pull the rug very soon, and I need to get job done while waiting hardware prices to go down...
No need to go from audio to text to reasoning, just from audio to output json for running a command via adb automatically and it's working crazy good.
Pretty cool model, especially since it's not a nanny, if you want to unlock your own devices, like rooting an Android, it will happily help instead of flagging you.
Available for free via OpenRouter and Nous free tier. Also via OpenCode Go, but you have to pay a $5–$10 subscription. APIs are hammered now, so service is bumpy.
I do use Anthropic and OpenAI mostly because it costs me 1/40 and 1/50 of the api prices, which is way cheaper than Chinese subscriptions, but I’m ready to jump ship when they pull the plug. Fortunately they have nothing that forces me to keep paying them, and I don’t pay the crazy enterprise subscription costs, just the personal account prices.
I also die to be able to run the OSS setup locally to stop being spied on all the time.
For context, I averaged 10 hours a day prompting LLMs from when ChatGPT came out. At the start it was just function generation, then single file modules, then modules, and now I reason, design, implement and test with them.
An interesting thing is that with omp you can plan with a smart model and then implement with a dumber one. So for example, plan with Kimi 3.1 via OpenRouter and then implement with DSFV4 with zero data retention active, sorted by cheapest, and minimal tps accepted.
I get the people who are pissed about their cushy jobs evaporating, but if you know how to use these technologies it’s very freeing because it’s like having a company of people working for you, except they are not human so they’re not wasting their life working for you instead of using it for themselves.
You can make them do pretty much everything that is fuzzy-verifiable, you don’t have to worry about their feelings or that they won’t do what you asked them to do or stop, and you can activate them when you want at scale in parallel or not use them at all for days.
For me it’s a dream honestly. I never felt so much empowered in my life while being enabled to unlock my creativity with almost no boundaries.