Comment

Comment by coffeekid

Pretty much. Running a local harness calling an llm via APIs doesn't necessarily take a lot of resources. But whatever tasks you want that agent to do via tool calling will be limited by the resources of the machine it runs on if you run those locally, so that's what should inform your choice of specs in this case
parent coffeekid 4 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton