tlonny
Joined 6 years ago
Joined 6 years ago
However, I'd argue that BI tooling could "dissolve away" altogether. As long as you have queryable data, an intermediate BI tool is unnecessary - just one-shot whatever dashboard you're interested in seeing...
I'm really curious how hackers have monetised the compromised API keys? Do they submit them to a shady AI-multiplexer that provides cheaper inference using stolen keys? One would expect completely random/disparate usage patterns/prompts if so...
Felt like that undermined some of the more cogent points the article was making.
Thus I think webhooks still have a place - but as a simple "poke" that can be sent to the client to tell them something has changed - supplementing a default low frequency polling interval.
This gives us the best of both worlds:
1. No need to bother de-duping/retrying pokes - if you miss a webhook you will shortly recover anyway when you next poll. 2. No need for any local-specific tunnelling/tooling - the local app will work just fine with the default poll interval. 3. No need to keep a connection live for each client. 4. All the good stuff OP mentioned in his blog post.
If you scrape stuff behind a sign-up, you potentially open yourself up to being sued for breach of ToS.
Now I'm sure the Chinese labs don't give a rats arse about that threat, but I imagine it stops the likes of Google, OAI, Anthropic from scraping and instead forces them to purchase the data.
"Using the attached image as a stencil/background - please generate a QR code for https://XXX"
into ChatGPT and got something valid that looks similar in style to your offering.
I think the age of trying to wrap a highly focused AI task in a SaaS has come and gone.
Hallways (https://hallways.lonnycorp.com) - a web browser for 3D spaces, where instead of hyperlinks you have portals that you can seamlessly walk through
LonnyMQ (https://lonnymq.lonnycorp.com) - a performant, production-ready TS PostgreSQL message queue library and accompanying blog post that walks through its design (of which I'm quite proud of)
Without any typechecking, LLMs obviously find it harder to work agentically and validate their work.
With too much typechecking (I'm looking at you, rust), I've found agents get themselves stuck in local "architectural minima" and end up doing insane shit to mitigate ownership/borrow-checker issues inherent in the design they ended up with.
That said, if you're hands-on I think rust is a fantastic language for pairing with an LLM.