maknee
Joined 3 years ago
Karma
129
Submissions
31
Member since
Dec 8
https://github.com/Maknee
View on Hacker NewsRecent submissions
Comment · 7 months ago
Thanks! Looks like I have to request the whitepaper to take a look at the details.
Comment · 7 months ago
How effective are LLMs at triaging issues? Has anyone found success using them to find the root cause? I've only been able to triage effectively for toy examples.
Comment · 9 months ago
Comment · 9 months ago
Great paper! Love the easy to understand explanations and detailed graphs :)
Comment · 10 months ago
Read through the comments. Added RSS and subscribe to my blog!
Comment · 10 months ago
It seems like the load_score serves a proxy for how much needs to be done. Is there a real value that could be used instead? The solution requires syncing with all of the GPU nodes anyways.
Comment · 11 months ago
Location: New York City, NY, USA (NYC)
Remote: Yes
Willing to relocate: No
Résumé: https://www.linkedin.com/in/henry-zhu-347233121/
Email: find email on my blog OR reach out on linkedin
LinkedIn: https://www.linkedin.com/in/henry-zhu-347233121/
Github: https://github.com/maknee
- Analyzed DeepSeek's distributed filesystem from the ground up in a multipart series
- Built a 100k+ (1TB+) RL dataset for a popular online MOBA game by reverse engineering data format (~50k -> ~100k downloads monthly on huggingface)
- Optimizing finetuning/RL on multi-node GPUs
- Built a framework that intercepts OpenGL pipelines and re‑renders them with NVIDIA ray tracing
I'm looking to work on optimizations and performance analysis of systems. This includes: building profiling tools, building and running large scale distributed systems (training, inference, vectordb, db, compilers, etc...), discussing napkin-math & identifying bottlenecks and writing about the work.
Comment · 11 months ago
interesting results. why does reload/cross-tile have worse results? would be nice to see some examples of failed results (how close did it to solving?)
Comment · 11 months ago
How does this compare against other DSLs?
Comment · 1 year ago
Great to see another distributed file system open sourced! It has some interesting design decisions.
Have a couple of questions:
- How do you go about benchmarking throughput / latency of such a system? Curious if it's different compared to how other distributed filesystems benchmark their systems.
- Is network or storage the bottleneck for nodes (at least for throughput)?
- From my observations from RDMA-based distributed filesystems, network seems to be the case.
- Very very interesting to go down the path of writing a kernel module instead of using FUSE or writing a native client in userspace (referring to 3FS [1])
- Any crashes in production? And how do you go about tracking it down?
- What's the difference in performance between using the kernel module versus using FUSE?