kinow

Joined 15 years ago

Karma
525
Submissions
336
Member since
Oct 4
From Casa Verde, Sao Paulo, Brazil. After 8 years in Auckland, New Zealand, now in Barcelona, Spain. Working with workflow managers at the BSC. Past work includes government, research, programming, GIS/fuzzy logic/web development/NLP/ontologies/etc., web development, UIUX, illustrations and design.

https://twitter.com/kinow https://github.com/kinow/ https://kinoshita.eti.br/ https://www.instagram.com/brunokinoshita/ https://www.deviantart.com/kinow

View on Hacker News

Recent submissions

Comment · 25 days ago
A short post, but it's every easy to read. Great job Daniel. Looking forward to more posts about this.

One recent case we had is that a developer noticed the memory wasn't being returned to the OS, and sent a pull request that forces `malloc_trim`. There are some Python projects that also do this call periodically, but while it works for `malloc` allocated objects, it doesn't work jemalloc, mimalloc (default for thread-free builds, if I'm not mistaken). It doesn't break either, but still...

The `malloc_trim` does seem to help producing a better memory usage pattern, but it's accompanying a `gc.collect`, so I'm being cautious and asking for more tests/benchmarks/etc.

Another developer has found a dictionary that seems to be the actual source of our problem, so we may not have to add `malloc_trim`, but maybe that'd be something interesting for a future post if you haven't already dug into that direction :)

Comment · 1 month ago
I hadn't thought of Fregue in some years! I helped them with their logo and some smaller issues back in the time. I will check out the latest commits to see what's being updated (hopefully not only dependabot:) ).
Comment · 1 month ago
I'm reading Matt's latest movie from Dungeon Crawler Carl series. A great fun way to unwind after programming all day! Will check the two other books you mentioned, thanks!
Comment · 3 months ago
Comment · 3 months ago
I work in a project with a similar goal, I think, but that was not related to AI: climate digital twins. I worked on two, EDITO (European Digital Twin of the Ocean, edito.eu), and currently on DestinE ClimateDT (Destination Earth Climate Adaptation Digital Twin, https://destination-earth.eu/).

These digital twins aim to simulate climate, oceans, atmosphere, wind speed, temperature, etc., regionally or globally. They apply physics, mathematics, software engineering, and high-performance computing to simulate the world. Both digital twins I mentioned use EuroHPC resources like CSC LUMI, BSC MareNostrum5, CINECA Leonardo, and soon others (and we also use other smaller HPCs).

Now there are some ongoing work about integrating AI/ML, LLM, etc.. I find it a better approach than building for LLM/AI-first, as it integrates existing components, and allows for AI to be used too. I think this could possibly be integrated as a component in a solution like this described in the article, as a component.

(There are other digital twins, for heart, human body, cities, urban climate, rivers, biodiversity, etc.)

Comment · 4 months ago
Comment · 4 months ago
I just finished a master's on HPC where I had to take some classes on CUDA, MPI+CUDA, OpenCL. Reading an article like this before the classes would have been a lot helpful! Especially the part just before and after "What does it mean for a warp to be eligible?".
Comment · 4 months ago
I'm finishing a masters here in Spain about HPC (uploaded the thesis last night). It's a joint program by two universities from Galicia (USC/UDC). I paid about the same the author did. The programme is great, loved the professors --- I contacted them after the class and the interactions were helpful/interesting. Like in the author's case, my master had a lot of practical work (which is good, being in computing/HPC). But the workload is *really crazy*. Assignment pretty much every week, with overlapping deadlines.

There's something here called "second chance", which I don't remember seeing this in Brazil. My wife did a masters at University of Barcelona and they also had a second chance. In every subject if you fail, then you take the exam or submit some assignments to get the required grade. Some students realised they wouldn't get a good grade, and preferred to skip the exam or assignment, just to get a better grade on the second chance to graduate with a good score/honours/etc.. I found that interesting, but I focused more learning things that would help me at $work and tried to avoid stress (I was probably the oldest student in my class, 40+ yo).

Comment · 5 months ago
Phantasy Star I was the first RPG I played when child. I remember my father showing us the basic commands, and then my brothers and I taking notes of items, magic, and drawing cave maps.
Comment · 5 months ago
Comment · 5 months ago
Nice post! Short and simple to read. Is epublish on GitHub or somewhere? It looks simpler than previous approaches I've seen.

I had the chance to help a bit with one of the AOSA books. It was a very powerful pipeline, but also quite complex to manage. IIRC it used pandoc (and a lot other tools).

So having a simpler alternative like epublish would be interesting if I have to work on another book in the future.

EDIT: sorry, just went to the main thread, and saw there you replied to another user it's not open source "yet" (hooray)

Comment · 5 months ago
That idea is different than what most are talking here in other comments.

The grammar and vocabularies don't match, but I think the worst are the expressions. Both sides have *a lot* of expressions that vary per context and location.

Comment · 5 months ago
> But about time the Internet Archive had a US-independent backup.

Agreed!

> The Internet Archive Switzerland, online at https://internetarchive.ch/, is a newly-formed Swiss non-profit foundation that will operate independently within its national context.

I think the Wikipedia Editors will have to decide whether they will add it to the existing page. The Operations section is still listing only U.S. data centers: https://en.wikipedia.org/wiki/Internet_Archive#Operations

Comment · 5 months ago
I had a class in my masters about data centers (HPC Infrastructures). The professor was using some data centers somewhere in the middle of USA, in an area with hot weather as example. He compared that with ideal scenario (weather, power source, etc.).

In one of the slides, there were factors that influence the decision of where to build a data center, and several of the items involved finding a place with enough space and skilled people to work at this data center. He also commented sometimes there is politics involved on choosing the place for a next data center.

Comment · 5 months ago
Just got an email from one HPC I have access in Germany. I guess all HPCs ans services like GH Actions are going to be offline for a bit. I think last time was on a Friday too, so it might be another Friday to organize emails, files, rotate backup/passwords...

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton