English
See more
A quick and easy way to analyze the syntax errors of a robots.txt file for your website!
Latest Version
Version
1.0
Update
February 9, 2017
Size
8.68KiB
Developer
lxrmarketplace.com
Category
Users
0 
Rating
0 ★
Manifest Version
2
Web Store Status
Extension ID
Languages Support
Permissions
UnlimitedStorage
Notifications
See more
Notifications
Robots.txt Validator Application
Description
Webmasters create a robots.txt file to instruct search engine robots to crawl and index pages that are a part of a website.
The robots.txt file can cause major trouble for your website. If the syntax is wrong you could end up telling search engine robots NOT to crawl your site, so the web pages WON'T appear in the search results.
The importance of analyzing the syntax error of a robots.txt file cannot be stressed enough!
This tool can help you to identify errors that may exist within your current /robots.txt file. It also lists the pages that you've specified to be disallowed.
Key Features and Benefits
• Validated and error free robots.txt file can be directly uploaded to your root directory.
• Identifies syntax errors, logic errors, mistyped words and also provides useful optimization tips.
• The validation process takes in account both Robots Exclusion De-facto Standard rules and spider-specific (Google, Yandex, etc.) extensions (including the new \"Sitemap\" command).
Read more
Webmasters create a robots.txt file to instruct search engine robots to crawl and index pages that are a part of a website.
The robots.txt file can cause major trouble for your website. If the syntax is wrong you could end up telling search engine robots NOT to crawl your site, so the web pages WON'T appear in the search results.
The importance of analyzing the syntax error of a robots.txt file cannot be stressed enough!
This tool can help you to identify errors that may exist within your current /robots.txt file. It also lists the pages that you've specified to be disallowed.
Key Features and Benefits
• Validated and error free robots.txt file can be directly uploaded to your root directory.
• Identifies syntax errors, logic errors, mistyped words and also provides useful optimization tips.
• The validation process takes in account both Robots Exclusion De-facto Standard rules and spider-specific (Google, Yandex, etc.) extensions (including the new \"Sitemap\" command).
Source Manifest.json
{"update_url": "https://clients2.google.com/service/update2/crx", "name": "Robots.txt Validator", "description": "A quick and easy way to analyze the syntax errors of a robots.txt file for your website!", "version": "1.0", "manifest_version": 2, "icons": { "128": "RV.png" }, "app": { "urls": [ "http://www.lxrmarketplace.com/robots-txt-validator-tool.html" ], "launch": { "web_url": "http://www.lxrmarketplace.com/robots-txt-validator-tool.html" } }, "permissions": [ "unlimitedStorage", "notifications" ]}
Read more
