objectivefs

Joined 13 years ago

Karma
263
Submissions
58
Member since
May 13
Built a secure shared filesystem on top of Amazon S3:

https://objectivefs.com

View on Hacker News

Recent submissions

Comment · 6 months ago
One advantage over S3FS would be that multiple filesystem mounts would see a consistent view of the filesystem, but it looks like this advantage disappears when mixing direct bucket access with filesystem mounts. Given the famously slow small file performance of EFS it might have been better (and cheaper) to send all files to S3 and only use EFS for the metadata layer. Not having atomic rename is also going to be a problem for any use that expects a regular filesystem.
Comment · 1 year ago
There is also ObjectiveFS that supports FUSE and uses S3 for both data and metadata storage, so there is no need to run any metadata nodes. Using S3 instead of a separate database also allows scaling both data and metadata with the performance of the S3 object store.
Comment · 1 year ago
Congratulations on your launch from ObjectiveFS! There is a lot of interest in 1-to-1 filesystems for mixed workloads, hope you can capture a nice share of that.

Using NFS and being able to use an existing bucket is a nice way to make it easy to get started and try things out. For applications that need full consistency between the S3 and the filesystem view, you can even provide an S3 proxy endpoint on your durable cache that removes any synchronization delays.

Comment · 3 years ago
Comment · 6 years ago
Comment · 6 years ago
Comment · 7 years ago
Comment · 8 years ago
Comment · 9 years ago
We are looking into the best way to add native kubernetes support. Currently, you can add a mount on the host or directly mount the file system inside the container. Both approaches work well, so it mainly depends on your preferred architecture.
Comment · 9 years ago
Comment · 9 years ago
Comment · 10 years ago
Comment · 10 years ago
Comment · 10 years ago
Comment · 10 years ago
We have some notes on small file performance for EFS and ObjectiveFS at https://objectivefs.com/howto//performance-amazon-efs-vs-obj... that you might find interesting. Scaling out PHP on AWS is definitively easier with a shared file system.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton