I think these are cheap and easy toy models to toss out for the big labs, to see what they can do with limited inference resources. I'm not sure what the plan is for a company like LFM that seems to be doing this as an entire business plan.
I see it as a niche now but it will hopefully grow in the future. The amount of information these servers are collecting about you for potential use against you is staggering and makes adware spy tech look like the good old days of privacy.
Strongest and easiest use case now would be just to hook one of these up to a search engine tool and ask your random questions to it rather than adding to OpenAI or Gemini's database about you.
I see it as a niche now but it will hopefully grow in the future. The amount of information these servers are collecting about you for potential use against you is staggering and makes adware spy tech look like the good old days of privacy.
Strongest and easiest use case now would be just to hook one of these up to a search engine tool and ask your random questions to it rather than adding to OpenAI or Gemini's database about you.