AvailableFree browser-local analysis

Meta Robots Checker

SiteTend Meta Robots

Find unintended indexing restrictions, conflicting crawler instructions, and invalid preview directives.

Your input stays private.HTML is analyzed in your browser.

Paste page HTML

Add markup containing the document head and robots metadata.

Paste the full document or its head element.

No validation message.

Pasted HTML stays in this browser and is excluded from analytics.

Review the policy

Start with indexing restrictions, conflicts, and invalid directives.

Your analysis will appear here

Paste HTML and select Analyze meta robots.

Help

Declare one clear page-level policy

Use one generic robots tag when explicit restrictions are needed. Avoid conflicting values, and review noindex, nofollow, snippet, archive, and preview limits before publishing.

Questions

Meta Robots Checker FAQ

What does the Meta Robots Checker analyze?

It checks generic and crawler-specific tags, duplicates, index and follow policy, conflicts, invalid directives, preview limits, archives, snippets, and image-indexing restrictions.

Is a meta robots tag required?

No. In its absence, search engines generally use index and follow defaults. Add a tag when the page needs an explicit policy.

Does this checker inspect HTTP headers?

No. X-Robots-Tag headers can impose separate rules and must be checked independently.

Does SiteTend store pasted HTML?

No. Analysis runs in your browser, and pasted HTML is excluded from analytics.

Apply the result

From finding to verified fix

Interpret the finding

Resolve contradictory directives first. The most restrictive supported instruction may control how a crawler handles the page.

Common causes to inspect

  • CMS and plugin directives combined
  • Staging noindex retained at launch
  • Different HTML and header directives

Practical next steps

  1. Choose the intended index/follow behavior
  2. Remove duplicate or conflicting directives
  3. Inspect the live response and request recrawling when appropriate

What this check cannot prove

The checker cannot see X-Robots-Tag headers, crawler-specific support, or the page's actual index status.

Recommended resources

Useful next steps for operating a website

For transactional email

Consider SMTP2GO for website-generated messages, form notifications, account notices, and other outbound system email.

Explore SMTP2GO

For measuring business inquiries

Use WhatConverts to measure which marketing sources produce calls, forms, and leads. It measures outcomes; it does not fix technical website issues.

Explore WhatConverts

For personal-data privacy

Consider Optery if exposed personal information or data-broker listings are a concern. It is a separate privacy resource, not an SEO or website-security scanner.

Explore Optery

SiteTend may earn a commission if you purchase through these links, at no additional cost to you. These services are optional and separate from SiteTend's free checks.