manibatra
Joined 14 years ago
Joined 14 years ago
We are already at a stage where AI is touching hearts.
- Got a couple of Raspberry Pi's and connected them to wifi.
- Installed https://k3s.io/ on them. One master node and one agent/worker.
- Started adding workloads
- Now I have PiHole, Tailscale, Promtheus, Grafana, Mimir, Homebridge, a custom Go app that I use to create a bunch of metrics, eg. from my solar power system, etc.
- Also added another agent/worker over time.
So start small and easy then go as fancy as you want depending on what you learn/play with.If you want a completely offline version you'd be running one of the open source LLMs locally. Otherwise put the embeddings in a VectorDB, query it for the context and send it to one of the completion APIs available (OpenAI, etc)
- https://crimson-glade-1527.section.app/ : to talk to www.section.io docs. I used straight up python and Gradio. The chatbot doesn't have memory. Just use a CSV for embeddings. Has limited functionality but does it's job well. https://github.com/manibatra/sectiongpt - consider this toy code which was hacked together in a few hours.
- Also building https://www.everbility.com : Using Langchain, Pinecone. I often found Langchain to be a bit of an overkill with it's so many abstractions if your use case is just sending one off prompts. It is powerful though for document ingestion and Agents (which is something I plan to use it more for). When using Langchain you will often have to debug a bunch of edge cases which is understandable since
A random hack I found for improving the quality of answers by a big factor was creating embeddings for entire documents and also sections of document. Resulted in search on the vector space being very accurate for big picture and granular questions.
- Pi-Hole : https://github.com/manibatra/kube-pihole (might be a little rough around the edges, I have to push a few updates)
- Homebridge
- A custom Golang app to poll metrics from my Solar setup and export them as Prometheus metrics
- Prometheus
- Grafana Mimir for long term metrics storage to S3
- Tailscale on all the nodes and all my machines so that I can access my homelab and Pi-Hole when I am on the move.
Bunch more things to add but it's a start!
- I can't switch between two tabs really fast. My workflow often involves alternating between two tabs.
- I can't quit, pin, mute a bunch of tabs using the Tab Overview with just keyboard shortcuts.
And thanks! I am glad you find it interesting!
I would have loved to. I would like the Web extension API to be less locked down with more fine grained permissions.
I can and will put more details into the privacy policy after the Christmas celebrations!
Appreciate it! I wish I could make more extensions but the API is locked down!