Remove Duplicates

About Remove Duplicates

Lists assembled from several sources collect repeats — email addresses, keywords, product codes. Removing duplicate lines leaves one of each and preserves the order of what remains.

How to use it

  1. Paste your list, one item per line.
  2. Remove the duplicates.
  3. Copy the cleaned list.

Worth knowing

Matching is literal, so trailing spaces, differing capitalisation and stray punctuation make two identical-looking lines count as different. Tidy the list first if the results look wrong.

Common questions

Is the order kept?
Yes — the first occurrence of each line stays where it was.
Can I find the duplicates instead of removing them?
This produces the de-duplicated list; compare counts before and after to see how many were removed.