Remove Duplicates from List
Remove duplicate lines from a pasted list, preserve first or last occurrence, ignore case when needed, and inspect duplicate frequencies.
Remove duplicate lines
Paste email addresses, IDs, URLs, names, tags, SKUs, or any plain text list and get one clean list of unique values.
- Trim whitespace and ignore blank lines.
- Compare with or without case sensitivity.
- Keep the first or last occurrence.
- Switch to duplicate-only mode to audit repeated values.
- Copy or download the result as TXT.
Order and matching rules
The default result preserves the first occurrence order. That fits contact cleanup, keyword lists, spreadsheet columns, log snippets, and one-off data hygiene tasks.
Browser processing
Deduplication runs in the browser tab. Avoid pasting secrets, credentials, or regulated personal data unless your workflow allows browser-side processing.
Frequently Asked Questions
Sources and References
Calculations are based on the listed reference sources. Links open in a new tab.
Related Tools
Sort lines online alphabetically, naturally, numerically, by length, randomly with a seed, or by a field inside each row.
Count list items, lines, words, unique values, duplicates, frequencies, characters, and numeric statistics from pasted text.
Shuffle a list into random order, use an optional seed for repeatable results, avoid adjacent duplicates, avoid fixed positions, and export TXT or CSV.
Encode UTF-8 text to Base64 or decode Base64 and Base64URL strings back to text in your browser.