cahaya
Joined 7 years ago
Karma
37
Submissions
41
Member since
Sep 25
Recent submissions
Comment · 5 days ago
I build my own take on this with https://document.bot
Build for aviation legal regulations/ compliance. Highly optimized search around large PDF's, Word, etc with offline, EU and frontier LLM options.
Comment · 2 months ago
Until recently my M1 Max 32GB 2021 was great until memory became the bottleneck.
My M1 Pro 8GB lasted me less than a year bcs with Docker dev stuff made it sluggish.
32GB was great for years until AI assisted productivity got so high with Codex.
Running 3 projects, 3 different worktrees, each either Docker compose or running/building Electron apps. So in this high AI era productivity my Mac is using insane amount of RAM and SSD space (bcs of all the worktrees)
Comment · 2 months ago
Agree, with you but I'm still using 3.6 Flash because of tok/s/ latency/ uptime with high context. Tried Grok 4.6 and it was scoring lower on some internal benchmarks or slower.
Comment · 3 months ago
Thanks for the post. For https://Document.bot (Kinda Cursor IDE for knowledge workers), im already trying to improve the harness (besides spotting bugs) using hillclimb experiments. More and more i'm using a AI harness engineering skill in Codex to further improve the app. This blog post helped me to improve the skill a bit.
Comment · 3 months ago
Nice, @grok how does it compare to Cloudflare that also provides a REST endpoint for structured markdown data and screenshots?
Comment · 3 months ago
When GPT-Live in Codex, so i can walk the dog while shipping?
Comment · 4 months ago
I'm not disagreeing with the article, but I think you are right that if you use AI in the right setting it can do much more than the average ChatGP that outputs Linkedin like crap:
interdisciplinary teams/person + SOTA AI + Right context (customer/ internal pain points, access to the code, focussed Hackathon) = amazing cool things.
Comment · 4 months ago
From X:
Today, we are releasing Rampart: a 14.7MB machine learning model designed to protect citizens’ privacy by redacting personal information directly in your browser before it gets sent to any server.
Comment · 4 months ago
Asking for feedback:
Sorry for hijacking the convo, but you (with local models) are my target audience in terms of hardware.
Is anybody willing to test my new app https://document.bot? It is like Cursor IDE but custom harness for knowledge work (PDF's, MS Office files etc).
You can connect your existing offline LLM models through LMStudio, Ollama, or app managed LLM models (Qwen3.5, Gemma 4, etc)
Might have to make a new Ask HN post for this, but again, you are users with good hardware setups.
Comment · 4 months ago
Same. Solving it by moving complex and sensitive data to an offline desktop app https://document.bot that support offline (self hosted) AI models (and optionally EU/ US AI providers).
However, it doesn't integrate yet with shared (org) drives.
Comment · 7 months ago
Building Cursor IDE, but for knowledge workers. Domain will go live soon on https://document.bot
Comment · 8 months ago
Hoping OpenAI/ Codex will launch this soon too.
Comment · 8 months ago
Nice. Curious about 5.3-codex-high results