pjb88
Joined 2 years ago
Joined 2 years ago
Seems like there's lots of warnings about equity bubbles, bond/debt problems, economic issues that will affect inflation (UK/EU), and gold is mega high. Seems like everywhere you look it's doom?
I've used Mint in the past, loved it until I spent a day trying to get scanner drivers to work. Don't know if that's changed now, was 4 years ago
I'm a fan, and I use Groq a lot for systems I build. I think they offer something different to most other providers (cheaper, faster, and until recently "we don't store your data by default") and it will be sad to see that fade.
I know this will not be relevant to anything but I thought it was a strange coincidence then I saw it on my hn feed.
- Don't use llamaindex/llangchain etc. - fine to get started quick but you'll quickly get frustrated when you try to do something different
- Suck in all your files using public libraries. convert to text. Remove obvious crap like line breaks etc. Don't worry about it too much.
- Use postgres as vectorDB - cheap.
- OpenAI is fine, and the docs are great - gpt 3.5 gives fine results; cheapest embedding model fine.
- Spend some time optimising the prompts - that's the most important thing.
I wrote up basics for my specific niche here, has cost/time breakdowns and costs about $4 per month for hosting (and only then because I couldn't face setting up postgres on my other server) and < $1 per 50GB of text/xlsx/etc embedded: https://superstarsoftware.co.uk/ai-for-drilling-engineers/
(as in: dirt cheap).
I basically made it as a showcase for potential customers, was half thinking of open sourcing it so people can get up and running quickly including with decent frontend, but not sure if there's much appetite since it's basic.
Or are they building a structure that's attractive for bugs to enter? What's the strategy for this web?