crawdog
Joined 14 years ago
Karma
307
Submissions
95
Member since
Feb 8
Created instant search/autocomplete for retailers with Walmart as my customer. ex Google & CapitalG
View on Hacker NewsRecent submissions
Comment · 4 months ago
Take a look at https://sbproxy.dev - I built it to address this very issue.
Comment · 4 months ago
I have been working on a project that is built off of Cloudflare's pingora project - https://sbproxy.dev. This provides all of the features of a LiteLLM, but can also support your API traffic too. I worked on the edge infrastructure for Walmart, and took those learnings and build a fully open source gateway.
Take a look - should be able to address your needs.
Comment · 6 months ago
Thanks I am finishing up some performance comparison work looking at rust vs golang and plan a deeper write up for that group. I hope to publish soon.
Comment · 6 months ago
I wrote a similar golang gateway, with the understanding that having solid API gateway features is important.
https://sbproxy.dev - engine is fully open source.
Another reason golang is interesting for the gateway is having clear control of the supply chain at compile time. Tools like LiteLLM the supply chain attacks can have more impact at runtime, where the compiled binary helps.
Comment · 6 months ago
SBproxy (https://sbproxy.dev) - An API and AI gateway as a single binary. Sits between your apps and LLM providers to give you more control. Think Cloudflare meets LiteLLM.
After the LiteLLM supply chain hack last month I feel pretty good about that choice. Your LLM gateway holds every provider API key you have. That probably shouldn’t be a pip install.
Worked on API gateway for a major retailer and incorporated my learnings into this platform.
Open source engine take a look!
Comment · 7 months ago
Entropy is real. Microsoft has lessened the friction of purchasing vs their competitors. Public Sector this may be their only choice because they set the groundwork decades ago to do business with most organizations. It may not be the best solution, but it offers the least resistance to getting something up and running.
Comment · 1 year ago
The supply chain impact on manufacturers in the US on contracts is overlooked in this tariff fiasco. For example - auto manufacturers enter into long term agreements as a fixed price for a product. The only negotiation point they may have to reset that price would be a government action, which a tariff checks the box. The genie is out of the bottle, lots of contracts will be negotiated and prices will go up.
I would like to think this is some kind of 4-d chess game to avoid rate hikes and to devalue the dollar, but on implementation it will accomplish none of the above with a sprinkle of recession.
Comment · 2 years ago
This was a great throw back. My interest in Electrical Engineering was traced back to building out simple circuits on this device. Little did I know my day to day at school was going to involve even more complicated circuits on a bread board - I was in heaven!
Comment · 3 years ago
This is an area that government subsidies could really influence change in urban planning and cutting oil demand. If there was a similar subsidy on bikes as there are on electric cars, I would expect the push back against bike infrastructure would become less. Right now in the Bay Area through poor design and aging infrastructure there is push back on bike lanes. An example is the Richmond bridge, which has a protected bike lane taking a 3rd lane of traffic that could see a larger number of riders if more ebikes become used. Likewise for the Bay Bridge, whose bike lane is a ghost town in the mornings when commute traffic is worst. This would be less of a problem if the lane went entirely to the city.
Comment · 3 years ago
Curious if this applies to political ad senders.