bach4ants

Joined 3 years ago

Karma

1

Submissions

5

Member since

Feb 26

https://petebachant.me

View on Hacker News

Recent submissions

Comment · 1 year ago

Are you saying that governments should try to reduce the number of humans?

Continuous Reproducibility: How DevOps could improve scientific research petebachant.me

1 bach4ants 1 year ago 0 comments

Comment · 1 year ago

And further, with this pg_mooncake extension allowing you to store the data in S3, is Postgres simply providing compute to run DuckDB? I suppose it's also providing a standardized interface and "data catalog."

Comment · 2 years ago

Yep. I personally like DVC's pipeline implementation because it's lightweight and language-agnostic, but haven't gotten into using their experiment tracking features.

Comment · 2 years ago

I have noticed this as well. There is a huge resistance to learning Git, and I think it's partly warranted. Researchers know what it is, and know that it's valuable, but think it will take too long to learn and they want to move fast. I recently started building a tool called Calkit (https://github.com/calkit/calkit) in an attempt to simply and unify Git and DVC for these types of researchers. Hoping to convince folks that working reproducibly is actually faster in the long run, never mind the fact that it makes their work more directly usable for pushing the field forward more quickly overall.