dilettanteee
tools/text-utilities/duplicate-line-remover

Duplicate Line Remover

Remove duplicate lines from a block of text, keeping the first occurrence.

Text
Output

Deduplicated text appears here.

More in this kitAll of Text Utilities

About Duplicate Line Remover

The Duplicate Line Remover deletes repeated lines from a list while keeping the first time each one appears. It tidies mailing lists, keyword lists, log extracts and any data pasted from a spreadsheet column.

How to use it

  1. Paste your list into the input panel, one item per line.
  2. Switch on Case-insensitive if lines that differ only in capitalization should count as duplicates.
  3. Copy the deduplicated list from the output panel.

Good to know

  • The original order is kept. Only later repeats are removed.
  • Lines must match exactly to count as duplicates, including spaces. Use the Whitespace Cleaner with Trim lines first if stray spaces are hiding duplicates.
  • Your text is processed in your browser and is never sent to a server.

Common questions

Can I sort the list as well?

Yes. Run the result through the Text Reverser & Sorter and choose Sort A→Z.

Does it remove blank lines?

Repeated blank lines are treated like any other duplicate, so only the first one is kept. To tidy blank lines more thoroughly, use the Whitespace Cleaner.