huniq writes deduplicated lines from standard input to standard output. It is
differentiated from the standard uniq by not requiring sorted input.
Internally, it uses Rust's standard HashSet type to accomplish this.
I originally created huniq for use in a pipeline with fzf. Since huniq
can start printing lines immediately (whereas sort -u needs to read all input
first), fzf can start matching more quickly.
Plus, it was a good excuse to finally start learning Rust. (This is the real reason, since I'm sure that better versions of this idea are already available.)
At this time, huniq must be compiled manually.
- Install Rust
cargo install --git https://github.com/ahamlinman/huniq.git
MIT (see LICENSE.txt)