Can anyone answer me: What is the hardware cost to run a single instance of a frontier model? I've heard everything from $25K to $3M.
I think it comes down to: Will the hardware cost for frontier models come down?
Also, here's a business idea: Web crawler for open weight models. You just pay a monthly fee so that your home model can continuously update on a large web crawl each hour/day.
I think it comes down to: Will the hardware cost for frontier models come down?
Also, here's a business idea: Web crawler for open weight models. You just pay a monthly fee so that your home model can continuously update on a large web crawl each hour/day.