110
Joined 10 years ago
Karma
346
Submissions
45
Member since
Aug 9
https://twitter.com/debanjum
View on Hacker NewsRecent submissions
Comment · 1 year ago
Potential solutions:
1. AI video watermarks that carry over even if a video of the AI video is taken
2. Cameras that can see AI video watermarks and put an AI video watermark on the videos of any AI videos they take
Comment · 2 years ago
Umm, customary, tongue-in-cheek reference to McCarthy's proposal for a 10 person research team to solve AI in 2 months (over the Summers)[1]. This was ~70 years ago :)
Not saying we're in necessarily the same situation. But it remains difficult to evaluate effort required for actual progress.
[1]: https://www-formal.stanford.edu/jmc/history/dartmouth/dartmo...
Comment · 3 years ago
Yes, this seems to be a common concern. We're trying to see how best to crisply address it. But yes, Khoj can be used even with your internet turned off
Comment · 3 years ago
We're still trying to figure out the right balance between configurability and ease of use/maintenance.
The 7B version was a decent enough starting point in terms of what it can answer (and way fewer folks can run a 13B on their machine).
If you really want you can just replace the 7B model file with the 13B one under the ~/.cache/gpt4all directory on your device and it should just work.
Comment · 3 years ago
Yes, of course
Comment · 3 years ago
It should work but not sure how fast. Best way to find out would be to try it.
We also have some fixes and perf improvements we plan to release later today in version 0.10.1
Comment · 3 years ago
Thanks for the feedback. Does your machine have a GPU? 32GB CPU RAM should be enough but GPU speeds up response time.
We have fixes for the seg fault[1] and improvement to the query speed[2] that should be released by end of day today[3].
Update khoj to version 0.10.1 with pip install --upgrade khoj-assistant later today to see if that improves your experience.
The number of documents/pages/entries doesn't scale memory utilization as quickly and doesn't affect the search, chat response time as much
[1]: The seg fault would occur when folks sent multiple chat queries at the same time. A lock and some UX improvements fixed that
[2]: The query time improvements are done by increasing batch size, to trade-off increased memory utilization for more speed
[3]: The relevant pull request for reference: https://github.com/khoj-ai/khoj/pull/393
Comment · 3 years ago
Khoj provides exactly that; it runs on your machine, none of your data leaves your machine and it has a web interface to chat
Comment · 3 years ago
Firstly, my previous statement needs quite a lot of clarification:
Khoj works more like an incremental, natural language version of org-agenda-search (or projectile) rather than isearch.
You've to configure which files it should index first. You can then use natural language to search those files with a search-as-you-type experience.
This is not the same as isearch that just searches the current file for keyword matches.
Second, khoj doesn't index source code and the default search models don't work well with code files.
But yeah someone should implement a natural language isearch as a standalone tool (as suggested by parent comment). It'd be super-useful
Comment · 3 years ago
Khoj exposes a local API. Hopefully that makes it easy to integrate with Raycast, Alfred (or even Spotlight)?
Comment · 3 years ago
Yeah, this would be ideal for Mac users. Just need to look into what is required and how much work it is
Comment · 3 years ago
Thanks for the feedback! Someone else mentioned this issue the other day as well. I'll fix this issue on the landing page soon
Comment · 3 years ago
To use Chat with non-english sources you'll need to enable OpenAI. Offline chat with Llama 2 can't do that yet.
And Search can be configured to work with 50+ languages.
You'll just need to configure the asymmetric search model khoj uses to paraphrase-multilingual-MiniLM-L12-v2 in your ~/.khoj/khoj.yml config file
For setup details see http://docs.khoj.dev/#/advanced?id=search-across-different-l...
Comment · 3 years ago
Thanks! :)