sarabande
Joined 10 years ago
Joined 10 years ago
The good thing about the developer experience is that it is dead simple to create keys that are time-bound, model restricted, and have budgets against them in an easy, programmatic way (also in bulk). Costs are guaranteed to be on par or lower than any model provider, so it's an easy sell to the finance department.
To look at it from the other side, Gemini is the absolute worse when it comes to key management. The labyrinth of actions that one has to navigate to generate budgeted keys for a team is not worth it and I still haven't figured out how to manage the keys at a granularity I need.
OpenAI and Anthropic both have what I would consider to be middling DevEx. Most things work, but only on their platform, and there are some weirdnesses, like the fact that anthropic disabled its admin API key creation, so you can't programmatically create keys against a budget.
My intuition is that German, for example, is much less active of a language in the US, where immigration peaked long ago, than Chinese, where immigration is active.
I do wonder if it is possible to agree on a general definition of the CTO from the perspective of the job to be done, rather than how they do it.
For example, we could say the job of the CTO is to ensure the company remains technically competitive. If they do it by means of building an organization then so be it. If they rather do it by writing code themselves, then why not?
I'm a VP eng/research at a startup and also feel like one of the few people apart from the founders who can push major technical initiatives by just doing it themselves, due to: business context, technical chops, architectural judgment, grit, and seniority to pull in cross-functional stakeholders to help out.
However, I have often questioned if it is correct that so few people in the org can do this and if I shouldn't be enabling others to do it themselves instead.
How have you been able to navigate not having any direct reports? Who does your engineering org report to and how are you able to manage conflict between org builders and your technical vision?
As someone in their 30s with children, work and a generally busy life, I wonder if anyone can recommend some pieces with more direct application - that is, in this vein, but perhaps an operational / how-to guide. Sometimes, it's hard to translate principles to action.
I bet it leads to more efficiency for everyone. When inbound robocalls deluge a business, the business pushes to cost-optimize its own service.
Business replaces humans with similar AI solutions to handle the phone modality, but hopefully then reverts to great service via email/API to reduce costs further.
Then, humans using AI voice services can "de-escalate" and revert to email/API AI, e.g. going from:
1. Business: AI (Voice) or Human | Customer: Human
2. Business: AI (Voice) or Human | Customer: AI (Voice)
3. Business: AI (voice) | Customer: AI (Voice)
4. Business: AI (Text) | Customer: AI (Text)
> But my personal lines definitely extend to don’t give money to people who enable fascism and don’t create value for them, either.