Can confirm, my experience in “loop engineering” was “this is neat” for 45 minutes until a daily ration of tokens was evaporated. The quadratic cost trap is prohibitive to experimentation.
As a localLLM evangelist, I am hopeful this will bring more attention to the joys of rolling your own sovereign AI.
As a localLLM evangelist, I am hopeful this will bring more attention to the joys of rolling your own sovereign AI.