Comment

Comment by oldmanhorton

It’s mostly from people using their personal accounts to run LLM services that serve a larger team or organization. At least at Microsoft, it’s still impressively hard to get access to an LLM for service usage with high enough rate limits to be useful, making running services on dev boxes much more appealing (despite the countless drawbacks that few people seem to care about around security, compliance, reliability, etc).

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton