Hashtag Extractor
Pull the hashtags out of posts and rank them by use.
Strip punctuation marks and keep the words.
Remove Punctuation strips punctuation marks from a text while keeping the words and spacing, which is the standard preparation step for word frequency work, readability scoring and machine learning tokenisation. Apostrophes, hyphens and sentence-ending marks can each be kept when your next step needs them.
Removing punctuation is normally a preparation step rather than an end in itself. Text analysis, word frequency work, machine learning tokenisation and Scrabble-style word puzzles all want the words without the marks around them, because "word." and "word" should not count as two different things.
Every Unicode punctuation character is removed, not just the ASCII ones — curly quotes, em dashes, ellipses and the full-width marks used in CJK text are all handled. Because the right answer depends on the job, you can keep specific marks: apostrophes so that contractions survive, hyphens so that compound words stay whole, or sentence-ending marks so that the text can still be split into sentences afterwards.
Curly quotes, en and em dashes, ellipses and full-width CJK marks are all removed, not just the ASCII set.
So "don't" does not become "dont" — the difference matters for every frequency and readability calculation.
Compound words stay as one token instead of fragmenting into four, which is usually wrong for analysis.
A mark joining two words is replaced so they do not fuse; a mark against one word is simply deleted.
Keep full stops, question marks and exclamation marks when a later step still needs to split the text into sentences.
A document, a transcript or anything you are preparing for analysis.
Apostrophes, hyphens and sentence-ending marks can each be preserved if your next step needs them.
Delete the marks outright, or replace each with a space so words do not run together.
Copy the result or download it as a text file for your pipeline.
Replace with a space when a mark joins two words, such as a slash or an em dash, or the words will fuse. Delete outright for apostrophes and marks that sit against a single word.
Yes. It works on the full Unicode punctuation category, not just ASCII, so curly quotes, en and em dashes, ellipses and full-width CJK marks are all included.
Because removing them turns "don't" into "dont" and "it's" into "its", which changes the word. For word frequency and readability work you almost always want apostrophes kept.
Only if you let it. With hyphens kept, "state-of-the-art" stays one token; with them removed, it becomes four separate words, which is usually wrong for text analysis.
What people who use the Remove Punctuation think of it. Reviews come from visitors and are posted as written.
No ratings yet
Yours would be the first.
0 reviews
Newest first
No reviews yet
Be the first to rate the Remove Punctuation. It takes half a minute and no account.
Write the first reviewPull the hashtags out of posts and rank them by use.
Flip the word order of a sentence without scrambling the letters.
Capitalise headlines properly using AP, Chicago, APA or MLA rules.
Find dates in any format and normalise them to one.
Find alternative words without leaving the page.
Find every occurrence of a word or pattern and see where it is.
Convert text into hexadecimal bytes.
Find which lines repeat in a list, and where they are.