Text Length Counter
Measure text length in characters, words, bytes and lines at once.
Strip repeated words, either the accidental ones or every repeat.
Words removed
None.
Remove Duplicate Words handles both problems that share the name: the accidental "the the" that survives an edit, and the repeated entries in a keyword or tag list. Adjacent mode is the safe proofreading pass; global mode keeps only the first occurrence of each word anywhere in the text.
There are two different problems that both get called duplicate words, and they need opposite treatment. The first is the accidental double — "the the", "and and" — which happens when a sentence is edited in the middle and is almost invisible to the person who wrote it. The second is a keyword list or tag string where every repeat should go.
This tool does both. Adjacent mode removes only consecutive repetitions, which is the safe proofreading pass — it will never delete a legitimate second use of a word later in the paragraph. Global mode keeps only the first occurrence of each word anywhere in the text, which is what a tag list or a keyword string needs. Case sensitivity and punctuation handling are both switchable.
Adjacent catches typing errors without touching legitimate repetition; global de-duplicates a list completely.
"cat," and "cat" compare as the same word, but the surviving word keeps its punctuation.
Catch "The the" as a duplicate, or keep case significant when your data treats "Apple" and "apple" as different.
You see exactly which words came out, so nothing disappears without your knowing.
Line breaks and spacing survive, so a de-duplicated list is still a list.
A draft you are proofreading, or a list of keywords and tags.
Adjacent removes only consecutive repeats; global keeps the first occurrence of each word anywhere.
Decide whether case and punctuation should be ignored when two words are compared.
Every removed word is listed, so you can check the tool did not take something you wanted.
Adjacent removes only a word immediately repeated after itself, which is the accidental typing error. Global removes every later occurrence of any word, which would destroy ordinary prose but is exactly right for a keyword list.
Adjacent, always. Ordinary writing repeats words constantly and legitimately, so global mode on a paragraph of prose produces nonsense.
By default yes, so "The the" is caught as a duplicate. Turn case sensitivity on if you are working with data where "Apple" and "apple" are genuinely different values.
With punctuation ignored, "cat," and "cat" are treated as the same word for comparison, but the punctuation of the word that survives is kept. That is what you want when a repeat straddles a comma.
What people who use the Remove Duplicate Words think of it. Reviews come from visitors and are posted as written.
No ratings yet
Yours would be the first.
0 reviews
Newest first
No reviews yet
Be the first to rate the Remove Duplicate Words. It takes half a minute and no account.
Write the first reviewMeasure text length in characters, words, bytes and lines at once.
Turn Unicode escape sequences back into characters.
Trim whitespace, or cut every line down to a maximum length.
Generate placeholder paragraphs, sentences or words for your mockups.
Compare two blocks of text and highlight every added or removed line.
Count paragraphs and see how long each one really runs.
Convert accented letters to their plain forms without losing the word.
Fix everything wrong with pasted text in a single pass.