Meta Robots Checker
SiteTend Meta Robots
Find unintended indexing restrictions, conflicting crawler instructions, and invalid preview directives.
Paste page HTML
Add markup containing the document head and robots metadata.
Review the policy
Start with indexing restrictions, conflicts, and invalid directives.
Your analysis will appear here
Paste HTML and select Analyze meta robots.
Help
Declare one clear page-level policy
Use one generic robots tag when explicit restrictions are needed. Avoid conflicting values, and review noindex, nofollow, snippet, archive, and preview limits before publishing.
Questions
Meta Robots Checker FAQ
What does the Meta Robots Checker analyze?
It checks generic and crawler-specific tags, duplicates, index and follow policy, conflicts, invalid directives, preview limits, archives, snippets, and image-indexing restrictions.
Is a meta robots tag required?
No. In its absence, search engines generally use index and follow defaults. Add a tag when the page needs an explicit policy.
Does this checker inspect HTTP headers?
No. X-Robots-Tag headers can impose separate rules and must be checked independently.
Does SiteTend store pasted HTML?
No. Analysis runs in your browser, and pasted HTML is excluded from analytics.
Apply the result
From finding to verified fix
Interpret the finding
Resolve contradictory directives first. The most restrictive supported instruction may control how a crawler handles the page.
Common causes to inspect
- CMS and plugin directives combined
- Staging noindex retained at launch
- Different HTML and header directives
Practical next steps
- Choose the intended index/follow behavior
- Remove duplicate or conflicting directives
- Inspect the live response and request recrawling when appropriate
What this check cannot prove
The checker cannot see X-Robots-Tag headers, crawler-specific support, or the page's actual index status.