What Duplicate Words helps you do
Show the words that appear more than once, with the number of occurrences. It surfaces repetition that is easy to miss when reading, which is useful for tightening copy and spotting accidental repeated terms. The output is a short edit list rather than a full frequency table.
Analysis runs in your browser with no upload to Haivix.
How it works
The text is tokenized into words, punctuation is treated as a separator, and each word is lowercased to form a key. The page counts occurrences and keeps the first spelling it saw. Words with a count above one are returned as a newline-separated list with the count in parentheses.
How to use Duplicate Words
- Paste the text.
- List the words that repeat, with their counts.
- Review the list for unintended repetition.
- Copy the findings into the editing notes.
When to use it
- Find accidental repeated words in a draft.
- Audit a text for overused terms.
- Check a keyword list for duplicates.
- Spot repeated product or brand names in a page.
- Review a translation for repeated filler words.
- Find terms that a glossary should define once.
When not to use it
- Do not use it as a style checker; repetition can be deliberate.
- Do not expect it to ignore stop words automatically.
- Do not use it to count total word frequency; it only lists repeats.
Example
A landing page repeats secure six times. The list shows secure (6), and rewriting two of the occurrences reduces the count without losing the key benefit. A keyword list with vpn twice produces vpn (2), which is a prompt to merge the entries. The count is per word, not per phrase, so a repeated slogan may not appear as one entry.
What you can do with Duplicate Words
- Find words that occur more than once.
- Show the count next to each repeated word.
- Compare words case-insensitively.
- Keep the first spelling of each repeated word.
- Ignore punctuation between words.
- Copy the list into an editing note.
Example: review a landing page
Paste the page copy and list the repeats. Ignore the and of, and focus on product names, verbs and qualifiers that carry meaning.
Read each repeated content word in context. If it repeats in two nearby sentences, rewrite one; if it is a necessary technical term, leave it and note why.
Re-run the list after editing to confirm the remaining repeats are intentional.
What to know before you start
- It does not judge whether repetition is intentional, such as a stylistic refrain.
- Accent and case differences may prevent two forms being grouped.
- There is no stop-word filter or sorting by count.
- The count is per word token, not per phrase.
- Very large texts are limited by browser memory.
Common mistakes
- Treating every repeated the or of as a problem.
- Assuming the count is case-sensitive when the comparison is not.
- Deleting a repeated technical term that the reader needs for clarity.
- Expecting the list to be sorted by count; it follows the first-seen order.
- Ignoring a repeated term that is split by a hyphen or apostrophe.
- Assuming a high count always means poor writing; a repeated key term can be correct.
- Deleting every repeat in one pass instead of rewriting one occurrence.
- Assuming a plural and its singular are counted together.
- Ignoring a repeated word because it looks like part of a product name.
Troubleshooting
If a repeated word is missing, check for a curly apostrophe, accent or hyphen that changes the token.
If common words dominate the list, filter them out in your editor; the tool does not remove stop words.
If the count looks wrong, compare the source for different forms of the same word.
If the output is empty, no word occurs twice or the text is too short for a repeat.
If a word is counted separately from its plural, the tokenizer treats them as different forms; check the source before editing.
If a phrase repeats but no single word does, the tool will not flag it; search the phrase manually.
If a plural or a different tense is not grouped with the base form, check the source; the tokenizer treats them as separate words.
If the list is dominated by the and of, filter stop words in the destination rather than deleting them from the source.
If a word appears with different capitalization in the output, the source may contain a character that breaks the lowercase key.
If a word repeats only in a heading and the body, it still counts; decide whether that is intentional.
Related standards and documentation
- Unicode text segmentation (UAX #29) explains why word boundaries differ between tools.
- Punctuation is treated as a separator, not as part of the word.
- Case-insensitive comparison.
- First spelling is kept.
- Stop words are not filtered.