ng-henry

Who needs Google Maps and a browser when you can have interactive maps over SSH? Made with Rust, ratatui for terminal rendering on the backend, and xterm.js for terminal emulation on the front-end.

this looks so cool!

congrats on the launch!!

We aren't changing the data, just changing how the graph is displayed.

See this comment I posted in another thread:

Yep this is only for stuff that we've crawled, so we can't detect all of your links. Because we have limited crawling resources, we rate-limit the crawling by domain so we don't get stuck in spider traps. The current visualization only shows the current state of the crawl, so it won't know about all of the posts.

We just haven't crawled your site yet! There's a lot of links so we can't crawl them all :(

Yep this is only for stuff that we've crawled, so we can't detect all of your links. Because we have limited crawling resources, we rate-limit the crawling by domain so we don't get stuck in spider traps.

The current visualization only shows the current state of the crawl, so it won't know about all of the posts.

I started off with my favorite blogs and recursively explored from there based on what they linked to.

To get their topics? I used a basic louvain community detection algorithm, then put all the URLs into GPT with some few-shot prompting tricks to get it to output a particular topic. There's some heuristics to break up giant communities / combine small communities in there too.

I scraped my favorite blogs and made a graph from the domains that each blog links to.

You can see clusters forming of websites that talk about similar topics, like crypto, rationality, Canada, India, and even postgres!

The visualization was made entirely in webgl with some neat optimizations to render that many lines and circles.