But, it isn't running locally. It uses tools locally but the LLM is still shipping the output of those tools to Anthropic and running the inference there.
A compromise to this would be Bedrock but that still ships the data to Amazon to execute the LLM on their processors.
A compromise to this would be Bedrock but that still ships the data to Amazon to execute the LLM on their processors.