darkbatman
Joined 7 years ago
Karma
33
Submissions
48
Member since
Jun 1
https://x.com/bhowconda
View on Hacker NewsRecent submissions
Comment · 1 month ago
I have been their user for more than year even used coding plans, though for normal coding the quota will definitely be a blocker if you are using opencode because rpm are bit less. Good for products/api though.
Comment · 3 months ago
also its pretty big model inference costs are high even with margins running a 2.8T model costs a lot. if they release oss may be it goes down to $10-12 per million tokens.
Comment · 4 months ago
This is crazy and would be frustrating, I probably would just be using another model as authority and keep fable as reviewer only in this case.
Comment · 7 months ago
I built https://meow.gs as a side project. It gives you a cloud shell via SSH, authenticated with Face ID / Touch ID instead of SSH keys.
ssh meow.gs from any terminal iPad, iPhone, laptop. Easy to work while remote and have ai coding tools on private vps and access from anywhere.
Though claude/codex now has remote access, this was created 1 month back but still helpful if you need own private tools on vps and accessibility without managing ssh keys.
Comment · 7 months ago
codex/gpt is a stubborn model, doubt it would accept claude reviews or counter it. have seen cases where claude is more willing to comply if shared feedback though its just sycophancy too.
Comment · 1 year ago
By looking at the paper, memory needed per layer seems to be higher than transformer architecture. Pretty sure that would be blowing up the vram of gpu at scale.
Comment · 1 year ago
Its so useful to use Cerebras api for other tasks too not just coding with qwen coder but even simpler things like lets say analysing with gpt-120 oss or llama.
Just plug it in with normal chat interface like Jan or Cherry studio and its incredibly fast.
Comment · 1 year ago
We kinda use https://github.com/googleapis/genai-toolbox but for databases looking forward if klavis provide more or general solution.
Ideally when we are writing agents we need mcp to support auth, custom headers because by design when deploying for saas we need to pass around client params to be able to isolate client connections.
We do token optimisation and other smart stuff to save token money. Looking forward to try this as well if this solves similar problems as well
Comment · 1 year ago
true, I was using Cline/Roocode from almost an year and it always made sure to read things from memory-bank which i really liked. Claude has gone downhill from August mid for me and often it doesn't follow instructions from claude.md or forget things mid-way.