Print duplicates: $ sort file.csv | uniq -d Create a new file without duplicates: $ awk '!seen[$0]++' file.csv > no_dup.csv Where I understand $0 is the whole line/row of arguments; so the whole line/row would have to be identical for it to be removed.