h2o_wine
Joined 11 months ago
Karma
13
Submissions
9
Member since
Nov 26
Recent submissions
Comment · 11 months ago
Comment · 11 months ago
My credit card isn't in there. The app was written 6 months ago where it stayed in Beta. I rolled it out as a way to reduce the cost of development. Use it or don't. It will be obsolete in another year or two when AI calls level in price.
Comment · 11 months ago
It's a tool not an SEO branded, shiny website. It's a utility.
& model pricing varies considerably for now. This tool will be useless in another year or two.
Comment · 11 months ago
I screwed up the routing & it sent everything to Anthropic when I updated from Beta & ended up losing money. The case study was done 6 months ago.
It's a simple tool. Use it or don't. The only person who would lose money in error is me.
Comment · 11 months ago
Actually I updated it to Gemini 2.0, GPT-4o, GPT-4o-mini, and Claude 3.5 Sonnet, Haiku. I did it when I realized I accidentally routed everything to Anthropic first & got hit with a $13.62 bill on rollout.
Moral of the story is, the only one who loses $ is me
Comment · 11 months ago
It totally isn't. In a reply above I explained how I accidentally routed to Anthropic first & ended up losing $13.62 before I realized my mistake.
The moral of the story,if something gets screwed up, I end up paying
Comment · 11 months ago
Actually, I accidentally routed to Anthropic first and ended up losing $13.62 but it does work. I've used it for two of my other projects.
I created it for people using AI in development. The 1st 50 tokens are free.
Comment · 11 months ago
Out of frustration, I built an AI API proxy that automatically routes each request to the cheapest available provider in real-time.
The problem: AI API pricing is a mess. OpenAI, Anthropic, and Google all have different pricing models, rate limits, and availability. Switching providers means rewriting code. Most devs just pick one and overpay.
The solution: One endpoint. Drop-in replacement for OpenAI's API. Behind the scenes, it checks current pricing and routes to whichever provider (GPT-4o, Claude, Gemini) costs least for that specific request. If one fails, it falls back to the next cheapest.
How it works: - Estimates token count before routing - Queries real-time provider costs from database - Routes to cheapest available option - Automatic fallback on provider errors - Unified response format regardless of provider
Typical savings: 60-90% on most requests, since Gemini Flash is often free/cheapest, but you still get Claude or GPT-4 when needed.
30 free requests, no card required: https://tokensaver.org
Technical deep-dive on provider pricing: https://tokensaver.org/blog/openai-vs-anthropic-vs-gemini-pr...
I wrote up how to reduce AI costs without switching providers entirely: https://tokensaver.org/blog/reduce-ai-api-costs-without-swit...
Happy to answer questions about the routing logic, pricing model, or architecture.
https://www.aiville.com/c/anthropic/api-that-auto-routes-to-...