Robots.txt Generator
Build a valid robots.txt with per-crawler rules in a minute.
Pull the domains out of a list of URLs and count them.
The Domain Extractor pulls every domain out of a list of URLs or a block of text, counts how many URLs each accounted for, and reduces them to hostname or registrable root as you choose. It carries the common multi-part suffixes, so example.co.uk reduces correctly where counting dots would not.
Paste URLs, or any text with URLs in it, and every domain is extracted, counted and listed. You choose whether to keep the full hostname, drop the www, or reduce everything to the registrable root so blog.example.co.uk and shop.example.co.uk count as one.
The root domain option is the one that takes real work, because you cannot get it by counting dots. example.co.uk has three parts and is a root domain; blog.example.com has three parts and is not. The tool carries the common multi-part suffixes — co.uk, com.au, co.jp, com.br and the rest — so the reduction is right for the domains most lists actually contain. Where it matters most is backlink analysis: five hundred links from one site is a very different fact from five hundred links from five hundred sites, and only a root-domain count tells the two apart.
co.uk, com.au, co.jp and the rest are handled, because you cannot find a root domain by counting dots.
Full hostname, hostname without www, or registrable root — whichever the analysis needs.
Five hundred links from one site reads very differently from five hundred sites, and this tells them apart.
Paste an email or a page of HTML and the addresses are found without cleaning it first.
The domains that account for most of the list come first.
A clean list, or a page of prose with links in it — URLs are found either way.
Full hostname, hostname without www, or the registrable root domain.
Each domain is listed with how many URLs it accounted for, most first.
The deduplicated domains, ready for a spreadsheet or an outreach list.
The registrable part — the bit you buy. example.com is a root domain; blog.example.com is a subdomain of it. It gets awkward with multi-part suffixes: example.co.uk is a root domain even though it has three parts, and you cannot work that out by counting dots.
Yes. The tool carries the common multi-part public suffixes, so example.co.uk reduces to example.co.uk rather than to co.uk. A full public suffix list runs to thousands of entries; this covers the ones real link lists contain.
Because they measure different things. Five hundred links from one site is one site's opinion of you, repeated. Five hundred links from five hundred sites is five hundred opinions. Referring domain counts are the more honest number, and this tool produces them.
Yes. Paste an email, a document or a page of HTML and the URLs are found within it. You do not need to clean the list first.
What people who use the Domain Extractor think of it. Reviews come from visitors and are posted as written.
No ratings yet
Yours would be the first.
0 reviews
Newest first
No reviews yet
Be the first to rate the Domain Extractor. It takes half a minute and no account.
Write the first reviewBuild a valid robots.txt with per-crawler rules in a minute.
Write responsive search ad copy against the real character limits.
Measure title tags in pixels, the way Google actually truncates them.
Address, hours, phone and geo as LocalBusiness JSON-LD.
Build the short link that opens your review box directly.
See the H1 to H6 outline and every level it skips.
Write a valid ads.txt so your ad inventory is not spoofed.
Steps, tools and materials as HowTo structured data.