lorey

Joined 12 years ago

Karma
645
Submissions
86
Member since
Dec 6
Formerly founded a venture capital fund, now building data APIs.

- https://karllorey.com

- https://github.com/lorey

- https://startupradar.co

- https://markets.apistemic.com

View on Hacker News

Recent submissions

Comment · 1 month ago
Comment · 1 month ago
Had the same issue. In the end, getting pulled into some Google Ads sales funnel and them solving the issue through internal tickets helped. Spent $1000 on useless ads in the process, but have an "unlocked" account now. Really disappointing customer experience.
Comment · 2 months ago
Comment · 3 months ago
What I read from that is that there's a chance claude gets worse using a claude.md and that's a usability issue on their side.
Comment · 4 months ago
Comment · 9 months ago
That is not what the article argues.
Comment · 9 months ago
Haha, very true. Exactly as described in the article.
Comment · 9 months ago
This is true with one caveat.

In most cases, e.g. with regular ML, evals are easy and not doing them results in inferior performance. With LLMs, especially frontier LLMs, this has flipped. Not doing them will likely give you alight performance and at the same time proper benchmarks are tricky to implement.

Comment · 9 months ago
This is a very good point. When I came in, the founder did a lot of evaluation based on a few prompts and with manual evaluation, exactly as described. Showing the results helped me underline the fact that "works for me" (tm) does not match the actual data in many cases.
Comment · 9 months ago
Doesn't this depend a lot on private vs company usage? There's no way I could spend more than a few hundreds alone, but when you run prompts on 1M entities in some corporate use case, this will incur costs, no matter how cheap the model usage.
Comment · 9 months ago
It's not you, it's the HN hug of death. There's so much load on the server, I'm barely able to download the redis image I need for caching...
Comment · 9 months ago
Thanks. Will take a look.
Comment · 9 months ago
Depends on your remaining budget ;)
Comment · 9 months ago
I've skipped that in the article, but absolutely!
Comment · 9 months ago
Fixed, thanks. Not a native speaker.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton