palewire

Joined 16 years ago

Karma
440
Submissions
62
Member since
Apr 2
https://palewi.re/who-is-ben-welsh/
View on Hacker News

Recent submissions

Comment · 5 months ago
The site includes a CSV of everything I found. You could hand that to Claude Code and ask it to pull down the WARCs
Comment · 5 months ago
Please give archive.org all the credit
Comment · 5 months ago
Comment · 5 months ago
Comment · 10 months ago
Thanks. I'm glad you found it interesting!
Comment · 10 months ago
Today I'm happy to release "First Basemap," a free tutorial that shares one of our most valuable recent innovations at Reuters.

It's at https://palewi.re/docs/first-basemap/

Follow the step-by-step guide and you'll learn how to create a shockingly fast and virtually free interactive map of the world.

This type of map is often called a basemap because it provides the foundation for displaying data layers like weather conditions, election results, demographics or the location of newsworthy events.

Until recently, creating a basemap was a difficult task that required specialized skills and expensive servers. Rather than take on the challenge, many organizations chose to pay for commercial mapping services, which can be costly for applications that draw a lot of traffic.

Then open-source software changed the equation.

Partnering with Scott Reinhard, we used Protomaps, OpenStreetMap, MapLibre and other free tools to craft a stylized version that will serve as the foundation for all Reuters mapping projects going forward. Casey Miller has already used it to track hurricane activity and share the latest forecast with our readers.

Scott has written a detailed explanation of his design process on his site. While the fonts, styles and other customizations he tailored for Reuters are copyrighted, his underlying techniques are free for anyone to adapt.

That's at https://scottreinhardmaps.com/blogs/custom-mapping-projects/...

One challenge in creating a basemap is the size of the massive database containing almost every border, road, building and natural feature on the planet.

"First Basemap" walks you through how you can use inexpensive cloud computing tools to solve the problem. Follow along and you'll have a basemap of your own for less than $10. Where you go from there is up to you.

Has anyone else on HN had experience rolling their own basemap? I'd love to hear how you're making it happen, what's working and what isn't.

Comment · 1 year ago
Comment · 3 years ago
The 392 news organizations listed at this URL have instructed OpenAI’s GPTBot to not scan their sites, according to a continual survey of 1,119 online publishers conducted by the homepages.news archive. That amounts to 35.0% of the total.

The artificial intelligence company has suggested it will not train future editions of ChatGPT using sites that opt out of GPTBot crawls via the robots.txt convention.

Our archiving system gathers each news organization’s robots.txt file twice per day. This page automatically updates with the latest results.

The sites we track are a best effort to cover a broad cross-section of news publishing.

That said, the sample is not comprehensive. It's also primarily focused on the English language market.

Comment · 8 years ago
There's a state database compiled by CHP called SWITRS that tracks traffic accidents. You can find it here. http://iswitrs.chp.ca.gov/Reports/jsp/userLogin.jsp

We don't call it out by name in the story, but it's the kind of existing government system that could be expanded to provide a better, official count of street racing deaths.

Our Los Angeles Times team has mined SWITRS in the past for other stories, like these:

http://graphics.latimes.com/la-pedestrians/

http://graphics.latimes.com/la-bike-hit-and-runs/

Comment · 8 years ago
Thanks!

If you're a Python person, I'd love to hear what you think of how I structured the notebook.

There isn't a set style for writing these and I've been experimenting with different forms lately.

In this case, I pushed back some of the bigger code chunks into separate Python modules.

Comment · 8 years ago
I appreciate your effort to bring some context to the analysis.

However, as we unpack in the story, our total is likely an undercount due to the problems in tracking street racing related crashes.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton