I do scientific computing in google cloud. When I first got started, I heavily relied on GCSFuse. Over time, I have encountered enough trouble that I no longer use it for the vast majority of my work. Instead, I explicitly localize the files I want to the machine that will be operating on them, and this has eliminated a whole class of slowdown bugs and availability bugs.
The scale of data for my work is modest (~50TB, ~1 million files total, about 50k files per "directory").
The scale of data for my work is modest (~50TB, ~1 million files total, about 50k files per "directory").