mayoi
Joined 4 years ago
Joined 4 years ago
https://www.gnu.org/philosophy/words-to-avoid.en.html#Conten...
Also, here's a good website in general for this kind of stuff, thank you Stallman: https://www.gnu.org/philosophy/words-to-avoid.en.html#Conten...
You love seafood, so just literally run grep on the entire page and if it contains the word then include it as a correct.
In reality, you will miss a lot of real seafood pages because they don't really need to mention "seafood" and context matters, so what? Chances are that that one website where person randomly added "I love seafood" to the top of the page will be the only page that you've ever wanted to see anyway.
There's too much data for you to go through in entire life in any case, so why worry about it as long as you can get something that's good enough? You will never get best data, if it was possible, google would be giving you best data already.
How do I know? Well, looking up my real name shows where I grew up, what school I went to, graduated, and even which exam I scored 100 on... And even some places I used to work for in the past, and while that part is going to make most people paranoid, I wish ALL results were as detailed as this one, but there's little you can do.
Whitelists that I wrote by hand also don't introduce new unexpected entries by the way :)
This instead could be more like RSS where as your crawler gets new sites, you get updates on new things, and you could filter in your crawler or in RSS client directly, doesn't matter.
As if you cannot look up address range of your own country then crawl your whole country for websites that may be hosted by people living locally.
As if you cannot do the same with a foreign country that interests you.
Maybe you could even find a list that only shows residential IP's so you're sure to be only finding webservers ran by individuals and not corporations.
And if somehow "port scanning" by trying to send a http request to a residential IP is illegal in your dystopian country, you can always start by scraping the site that you're interested in, there will always be at least one more link to another domain somewhere.
For large scale servers python is shit, but that doesn't mean that you cannot spend few weekends writing your own python crawler for your needs, which is so easy that you don't need to be a programmer to do it, and if you really care about this at all, a bit of a startup hurdle won't make you immediately disinterested.
And if it really does, there's always options like https://yacy.net/
You should see these things more like real life. If you wanted to know more about your own neighbourhood, what better way is there than to go outside and walk around your neighbourhood and see things with your own eyes?
Maybe that's just my opinion, but status quo is noone's but your own fault, because I never had this problem.
I've been "awake" for 42 hours before, but the the second day was probably the least productive one out of my entire life, and I don't even remember it at all, it's like it never happened.
Why would I trust "br3f" with "sensitive URL"? Why would it be accessible by anyone or from anywhere to begin with? And most importantly, why would I put it in email which is literally the least secure form of communication?