sthoward
Joined 6 years ago
Karma
5
Submissions
14
Member since
Mar 25
Recent submissions
Comment · 1 year ago
Comment · 1 year ago
DeepSeek... so hot right now.
Comment · 1 year ago
Really well written Mathi.
Comment · 1 year ago
Try Oxen.ai
Comment · 2 years ago
Great thought. Right now we are optimizing for moving data from machine A to machine B, but getting data to the GPU is interesting. We're on it.
Comment · 2 years ago
Hey all,
If you haven't seen the Oxen project yet, we have been building an open source unstructured data version control tool.
We were inspired by the idea of making large machine learning datasets living & breathing assets that people can collaborate on, rather than the static ones of the past. Lately we have been working hard on optimizing the underlying Merkle Trees and data structures with in Oxen.ai and just released v0.19.4 which provides a bunch of performance upgrades and stability to the internal APIs.
To put it all to the test, we decided to benchmark the tool on the 1 million+ images in the classic ImageNet dataset.
The TLDR is Oxen.ai is faster than raw uploads to S3, 13x faster than git-lfs, and 5x faster than DVC. The full breakdown can be found here.
https://docs.oxen.ai/features/performance
If you are in the ML/AI community, or rust aficionados, would love to get your feedback on both the tool and the codebase. We would love some community contribution when it comes to different storage backends and integrations into other data tools.
Comment · 2 years ago
This has the legitimate possibility to be the most telling spam or ham (and funniest) yet. Very interested in the state by state breakdowns.
Comment · 2 years ago
So how many different prompts did you try it on?
Comment · 2 years ago
Lol, should we add this as a metric for repos over on www.oxen.ai?
Comment · 2 years ago
This was wild... especially the live session :) The convo after was truly great. Great video and paper recap!
Comment · 2 years ago
More than just an alternative - built better, faster workflows.
Comment · 2 years ago
Would suggest our weekly paper club called Arxiv Dive - https://lu.ma/oxenbookclub. You can see past ones on our blog (https://blog.oxen.ai/) - have covered papers like Mamba, CLIP, Attention is all you need, and more. We also do a "hands on" session with live code, models, and real world data on Fridays!
Comment · 2 years ago
Sign up here: http://lu.ma/oxenbookclub
https://github.com/Oxen-AI/Oxen
or check out the performance numbers https://docs.oxen.ai/features/performance