edwin

Joined 19 years ago

Karma
58
Submissions
24
Member since
Feb 5
urban chicken farmer; data + model wrangler

https://twitter.com/edwin

View on Hacker News

Recent submissions

Comment · 6 months ago
There’s something quietly impressive about getting modern AI ideas to run on old hardware (like OP's project or running LLM inference on Windows 3.1 machines). It’s easy to think all the progress is just bigger GPUs and more compute, but moments like that remind you how much of it is just more clever math and algorithms squeezing signal out of limited resources. Feels closer to the spirit of early computing than the current “throw hardware at it” narrative.
Comment · 8 months ago
Comment · 1 year ago
Unlike classic search, which got worse over time due to SEO gamings, AI search might actually improve with scale. If LLMs are trained on real internet discussions (Reddit, forums, reviews), and your product consistently gets called out as bad, the model will eventually reflect that. The pressure shifts from optimizing content to improving the product itself.
Comment · 1 year ago
We looked at the same data that Rand Fishkin used and definitely came to a different conclusion.
Comment · 1 year ago
Comment · 3 years ago
Comment · 3 years ago
That's not the current OpenAI recipe. Their expectation is that your custom data will be retrieved via a function/plugin and then be subsequently processed by a chat model.

Only the older completion models (davinci, curie, babbage, ada) are avaialble for fine-tuning.

Comment · 3 years ago
With LLMs, the inputs are highly variable so exact match caching is generally less useful. Semantic caching groups similar inputs and returns relevant results accordingly. So {"dish":"spaghetti bolognese"} and {"dish":"spaghetti with meat sauce"} could return the same cached result.
Comment · 3 years ago
New techniques like semantic caching will help. This is the modern era's version of building a performant social graph.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton