Comment

Comment by matheusmoreira

> at scale, to the degree that you're taking down my site

Fair. Scrapers should be polite and do their utmost to consume the smallest possible amount of resources.

> without my consent by masking your user-agent

Your consent is not required. It's my user agent. I set it to whatever I want.

> for the purpose of stealing data I didn't authorize you to have

Data can't be "stolen", only copied.

You set up an HTTP server that literally sends people the data when they request it. Don't do that if you don't want people to have the data. Secrecy is the only possible defense.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton