Remove Duplicate Lines

Clean up email lists, log files or any text where lines repeat. Choose whether to ignore case and extra spaces, and keep the first or last occurrence.

Input lines0
Duplicates removed0
Unique lines0

How to use the Remove Duplicate Lines

Paste your list or log with one item per line.

Pick options — case sensitivity, trimming empty lines, and whether to keep first or last occurrence.

Click Remove duplicates and copy or download the clean list.

Frequently asked questions

Will it mess up the order of my list?

No — unique lines keep their original order, whichever occurrence you choose to keep.

What does “case sensitive” mean here?

With case sensitivity off, Apple and apple count as the same line; with it on they are treated as different items.

How large a list can it handle?

Lists with tens of thousands of lines process instantly in modern browsers, entirely in memory.

Related tools