Free Meta Robots & X-Robots-Tag Generator
Choose the indexing, link-following and snippet rules you want and copy the meta tag and the matching HTTP header.
Free, with no sign-up. Fair-use limits apply. To enforce them we keep the domain you enter and a scrambled form of your IP address for 30 days, as described in our privacy policy.
Two ways to give the same instruction
A meta robots tag lives in a page’s head. An X-Robots-Tag is sent as an HTTP header, which is the only option for files that have no head, such as PDFs and images. They carry the same directives.
How to use it
Choose whether the page may be indexed and its links followed, tick the extra restrictions you want, set a snippet length or image preview size if needed and choose which crawler the rule applies to. Press Generate directives and copy the tag or the header.
Use noindex with care
A page that is blocked in robots.txt cannot be crawled, so its noindex tag is never seen. To remove a page from results, allow crawling and add noindex. Check your file with the robots.txt tester.
Frequently asked questions
What is the difference from robots.txt?
Robots.txt controls crawling. Meta robots controls indexing and snippets for a page that has been crawled.
Should I use nofollow on every link?
No. Use it for links you do not vouch for. See the link attribute analyzer.
How long until a noindex takes effect?
When the page is next crawled, which can take days or weeks.
More free tools
See all free tools, or read about the Domain Tools in the dashboard.