People often use sort | uniq when they don't want to load a bunch of lines into memory. That's why it's slow. It uses files and allocates very little memory by default. The pros? You can sort hundreds of gigabytes of data.
This Rust implementation uses hashmap, if you have a lot of unique values, you will need a lot of RAM.
This Rust implementation uses hashmap, if you have a lot of unique values, you will need a lot of RAM.