I run https://text-generator.io competing with OpenAI. I used to use kubernetes on Google cloud, but now run it from my house behind a CloudFlare tunnel believe it or not
Using my own GPUs allows me to undercut them with around 10x cheaper pricing.
The product is built with some open source and some retrained models, it analyses input links or linked images with tesseract/unified IO / OFA / beautiful soup so it can answer questions about images/receipts etc.
The site itself is on app engine standard python with stripe/firebase UI for auth, which is running very cost effectively.
In future in planning to layer on more content understanding eg audio with whisper etc, then milvus/haystack for lookup phases for more factual question answering, then some work on automated retraining and regeneration etc for hard cases, then searching other systems/internal code and logic execution etc, eventually with a few more steps I'm hoping it will feel like I made AGI in a rack in my house lol...
The product is built with some open source and some retrained models, it analyses input links or linked images with tesseract/unified IO / OFA / beautiful soup so it can answer questions about images/receipts etc.
The site itself is on app engine standard python with stripe/firebase UI for auth, which is running very cost effectively.
In future in planning to layer on more content understanding eg audio with whisper etc, then milvus/haystack for lookup phases for more factual question answering, then some work on automated retraining and regeneration etc for hard cases, then searching other systems/internal code and logic execution etc, eventually with a few more steps I'm hoping it will feel like I made AGI in a rack in my house lol...