Input list
Paste lines to clean
Ready.
Text utility
Duplicate Line Remover
Clean text lists by keeping first or last unique occurrences, extracting duplicates, counting rows, normalizing Unicode and whitespace, ignoring case and locale-sorting output in your browser.
Local only
Line statistics
Duplicate summary
Total lines0
Blank lines0
Unique lines0
Duplicate groups0
Removed rows0
Output lines0
Duplicate groups
| Line | Count | First row | Last row |
|---|
Popular duplicate-line tasks
Mode reference
| Mode | What it returns | Best for |
|---|---|---|
| Keep unique lines | One selected occurrence of each line | Cleaning emails, keywords and IDs |
| Show duplicate lines only | One row for each value that occurs more than once | Finding repeated records |
| Show removed occurrences | Every occurrence excluded by the keep-first or keep-last rule | Auditing exactly what changed |
| Show line counts | Each unique line with its occurrence count | Quick frequency analysis |
Duplicate line notes
Local processingYour list is processed in the browser and is never uploaded.
Case and sortingCase-insensitive matching and locale-aware numeric sorting follow the current page language.
Whitespace rulesTrim and collapse options clean copied spreadsheets, logs and keyword exports.
Unicode normalizationNFC matches canonically equivalent accents; NFKC also folds compatibility forms such as full-width characters.
Duplicate line remover FAQ
Does the tool keep the first duplicate or the last?
You can choose either. Unique output and removed-occurrence auditing follow the selected keep rule.
Can I remove empty lines at the same time?
Yes. Keep Remove blank lines enabled to omit empty rows; disable it to treat blank lines as a normal value.
Why use Unicode normalization?
Visually identical text can use different Unicode sequences. NFC merges canonical equivalents, while NFKC also merges compatibility forms.
Can I sort after removing duplicates?
Yes. Choose ascending or descending locale-aware sorting; count mode is sorted by line value rather than count prefix.