railka
Joined 2 years ago
Karma
103
Submissions
24
Member since
Feb 10
Joined 2 years ago
There is no distributed execution of a single LLM across multiple GPUs using tensor parallelism here. Instead, it relies on task-level parallelism-breaking down a large workload into independent subtasks that run across separate machines. For example, generating embeddings for a million documents.
But: Hyper, Bytes, Mio, Axum, Prost
Overall, after working with Warp, Ghostty+Herdr, and tty7, tty7 has felt the most comfortable so far.
tty7 has its drawbacks too - the biggest one for me is the lack of support for switching tabs with `Cmd+Shift+[` and `Cmd+Shift+]`.