Data cleaning 101: a few commands to clean csv or tsv files

Duplicates Print duplicates rows: $ sort file.csv | uniq -d For the following examples I assume email addresses are the fifth column of a csv file. Print the column with email addresses only: $ cat file.csv | cut -d ',' -f 5 Sort the output of cat to group duplicates: $ cat file.