Remove Duplicate Lines

Paste a list and get a clean copy with every repeated line removed. Ignore case or whitespace, drop blank lines and sort the result if you like.

Input
Output
Matching
Cleanup
Keep

How to use Remove Duplicate Lines

  1. Paste your list into the Input box, one item per line.
  2. Choose whether case and surrounding spaces should be ignored, and whether to drop blank lines or sort.
  3. Copy the deduplicated list from the Output box or download it.

Features

Exact or fuzzy

Match lines exactly, or ignore case and whitespace.

Sort while you dedupe

Optional natural A–Z sort of the result.

Find the repeats

Switch to “Only the duplicates” to see what was repeated.

Private

Text is processed in your browser and never sent anywhere.

Frequently asked questions

Which copy of a duplicate is kept?

The first occurrence stays in its original position; later repeats are removed. Enable Sort if you want the result alphabetised instead.

Are “Apple” and “apple” duplicates?

Only if Ignore case is ticked. Likewise, “item ” with a trailing space matches “item” only when Ignore spaces is on (it is on by default).

Can I see just the duplicated lines?

Yes. Choose Keep: Only the duplicates to output each line that appeared more than once, listed once.

Is there a size limit?

No fixed limit. Lists with hundreds of thousands of lines are processed in your browser in a fraction of a second.