Runs locally in your browser
Remove Duplicate Lines
Remove duplicate lines from lists, logs, and exports. Keep the first or last match, optionally sort, and copy a clean list locally.
Paste a mailing list, a log dump, or a column from a spreadsheet when the same row appears twice. This tool uniques lines, it does not rewrite wording.
Matching and filtering happen in the browser. Nothing you paste is stored on a server.
How to use
- Paste the list, one item per line.
- Choose keep first or keep last, plus case sensitivity and optional sort.
- Copy the unique lines.
How it works
By default the first time a line appears is kept. Switch to last if a later revision should win.
Turn off case sensitivity to treat Hello and hello as the same line. Sort applies after duplicates are dropped.
Examples
Email list
A newsletter export with the same address on three rows keeps one row and drops the repeats.
Build log
Repeated warning lines collapse so you can scan unique messages from a noisy compiler log.
FAQ
Are blank lines treated as duplicates?
Yes. Repeated empty lines collapse to a single blank line if they match.
Does order stay stable?
Yes when sort is off. Keep first preserves original order of first sightings.
Is matching whole-line only?
Yes. Partial overlap inside a line does not count as a duplicate.
Does text leave my machine?
No. Deduping runs in this browser tab.
Related tools
- Remove Extra SpacesCollapse extra spaces, trim edges, and clean text pasted from Word or PDFs. Whitespace cleanup runs entirely in your browser.
- Text Diff CheckerCompare two versions of a draft side by side. Spot insertions and deletions by character, word, or line without sending text away.
- Case ConverterSwitch headlines and identifiers between uppercase, lowercase, title case, camelCase, PascalCase, snake_case, and kebab-case without uploading.
- Word CounterCount words, characters, sentences and paragraphs instantly.
- Slug GeneratorTurn a page title into a URL slug: lowercase, accents stripped, words joined with hyphens. The conversion stays in your browser.