Checks if a page is crawlable, indexable, followable for robots to ensure SEO performance

Latest Version

Version
1.7
Update
July 2, 2024
Size
13.05KiB
Developer
estevecastells.com
Category
Users
336
Rating
5 ★
Manifest Version
3
Web Store Status
Languages Support
English
See more
Permissions
ActiveTab
Scripting
Tabs
Storage
Http://*/*
Https://*/*
See more

SEO Robots Inspector Extension

The SEO Robots Inspector is a powerful Chrome extension designed to help SEO professionals and webmasters ensure their webpages are properly configured for search engine crawling, indexing, and following. This tool evaluates crucial SEO factors and provides detailed insights to optimize your site's performance on search engines.

Key Features:

- Meta Robots Tag Analysis: Checks if the page has a meta robots tag and determines its directives (index, noindex, follow, nofollow).
- Canonical URL Detection: Identifies the canonical URL and verifies if it matches the current page URL to prevent duplicate content issues.
- Local Robots.txt Parsing: Fetches and analyzes the robots.txt file locally, ensuring that important URLs are not blocked from being crawled without relying on external APIs.
- Visual Indicators: Provides clear visual feedback using color-coded indicators for indexability, followability, crawlability, and canonical status directly in the browser's extension icon.
- Blocked URLs Highlighter: Highlights URLs blocked by the robots.txt file directly on the webpage for easy identification.
- HTTP Headers Inspection: Fetches and displays the X-Robots-Tag header to check for additional indexing and following rules set at the server level.
- On-Demand Analysis: Perform on-demand analysis of any active tab to get up-to-date information on the page's SEO status.

How It Works:

- Active Tab Analysis: Automatically analyzes the active tab when the page loads, when the user activates the extension, or when tab/window focus changes.
- Data Collection: Collects meta robots content, canonical URL, X-Robots-Tag header, and robots.txt information.
- Local Robots.txt Processing: Fetches and parses robots.txt files locally, applying rules for different user agents including Googlebot.
- Status Display: Displays the SEO status in a popup window with easy-to-understand indicators and detailed information.
- Highlight Blocked URLs: Allows users to highlight all URLs blocked by robots.txt on the page for immediate visibility.

User Interface:

- Results Section: Shows the indexable, followable, crawlable status, meta robots content, X-Robots-Tag content, robots.txt info, and canonical URL.
- Actions Section: Includes a button to highlight blocked URLs on the page.
- Explanation Section: Provides a legend for the visual indicators used in the extension icon and analysis results.

Permissions:

- Active Tab: Needed to analyze the content of the currently active tab.
- Scripting and Storage: Used for injecting scripts and storing tab status locally.
- Host Permissions: Required to fetch and analyze robots.txt files and X-Robots-Tag headers from all websites.

Installation and Usage:

- Install the Extension: Add the SEO Robots Inspector from the Chrome Web Store.
- Analyze Pages: Navigate to any webpage and click on the extension icon to analyze its SEO status.
- View Results: Check the detailed results in the popup window.
- Highlight Blocked URLs: Click the \"Highlight Blocked URLs\" button to see which links are blocked by robots.txt.

Advanced Features:

- Real-time Updates: The extension icon updates in real-time as you navigate between tabs or pages.
- Efficient Robots.txt Handling: Implements caching and timeout mechanisms for efficient robots.txt fetching and parsing.
- Detailed Rule Matching: Provides specific information on which robots.txt rule matched for the current URL.

Enhance your SEO workflow and ensure your website's pages are optimized for search engines with the SEO Robots Inspector! Get instant insights into crawling, indexing, and canonical issues without leaving your browser.
Read more

Source Manifest.json

{"update_url": "https://clients2.google.com/service/update2/crx", "manifest_version": 3, "name": "SEO Robots Inspector", "version": "1.7", "description": "Checks if a page is crawlable, indexable, followable for robots to ensure SEO performance", "permissions": [ "activeTab", "scripting", "tabs", "storage", "http://*/*", "https://*/*" ], "host_permissions": [ "" ], "action": { "default_popup": "popup.html" }, "background": { "service_worker": "background.js" }, "content_scripts": [ { "matches": [""], "js": ["content.js"] } ], "web_accessible_resources": [ { "resources": ["highlightBlockedUrls.js"], "matches": [""] } ]}
Read more

How to download and manually install SEO Robots Inspector extension for Chrome

Looking for a way to install SEO Robots Inspector extensions for Chrome, you can search for them in the Chrome Web Store, clicking the "Add to Chrome" button, and following the straightforward process.

However, you may need to install SEO Robots Inspector extensions manually, this article outlines two simple methods to effortlessly install SEO Robots Inspector extensions, whether they come as unpacked folders in compressed formats like .zip or as .crx files.

Method 1: Download SEO Robots Inspector extension and manually install through Drag &Drop

If you ever need to manually install a SEO Robots Inspector extension for Chrome, don't worry, it's a simple process. Just follow these easy steps, and you will have your extension ready to use in no time.

Step 1: Download the SEO Robots Inspector Extension by clicking the "Download CRX" button on the website.

Look for the SEO Robots Inspector extension you wish to install. Go to the website and download the SEO Robots Inspector extension package, which is usually a .CRX file and comes in a zipped file. Here ".crx" file is the format for SEO Robots Inspector extension that contains all the data.

Step 2: Extract &Arrange Files

Once the file is downloaded, extract that file into its own folder. Similarly, give that extension files a permanent home. In other words, keep it in a folder that you don't accidentally delete it because these files will be needed to make that extension work.

Step 3: Go to the Chrome Extensions Page

Open Google Chrome and in the address bar, type chrome://extensions; it will open the Google Chrome extensions page. Make sure that "My extensions" is selected in the sidebar.

Step 4: Drag and Drop the Extension

Now, go to the folder where you extracted the SEO Robots Inspector extension and drag &drop the extension file from there anywhere onto the extension page within Google Chrome.

Step 5: Complete the Installation

Once you drag and drop the extension file, follow the steps that Google Chrome takes you through. Similarly, if the extension file is of .crx file format, you will be required to review the permissions and then add the extension.

Now, you can manage that added extension as you would like to with any other Chrome extension that you added through Chrome Webstore. Its icon will also appear in the Google Chrome Menu on the right side of the address bar once you activate it.

Method 2: Download SEO Robots Inspector extension for Chrome and install in Developer Mode

This is another method to install SEO Robots Inspector extension manually, but the twist is that here, you install by enabling the developer mode option provided in Google Chrome. This mode is commonly used for testing extensions or running unpublished tools.

Step 1: Download the SEO Robots Inspector extension file

Select and download the SEO Robots Inspector extension by clicking the 'Download CRX' button on the website.

Step 2: Extract the downloaded contents

Convert the file to a ZIP file if it is in CRX format then extract the SEO Robots Inspector extension zip file or folder that you downloaded. Make sure you extract it using the same folder name and keep it safely in another folder, so you don't delete it by mistake. The extracted folder will be needed to keep your SEO Robots Inspector extension running.

Step 3: Open Chrome Extension Setting Page

In the address bar of Google Chrome, type chrome://extensions and open the Chrome Extension Page.

Step 4: Enable Developer Mode

After opening the Chrome Extension page, look at the top right side, and you will find the toggle option of "Developer mode."Simply enable that developer mode option.

Step 5: Load the Unpacked Extension

Once you enable the developer mode option, you will see the menu of Load Unpacked, Pack Extensions and Update. From that, select the option "Load unpacked."

Step 6: Select the Extension Folder

Once the pop-up opens upon clicking Load unpacked, select the SEO Robots Inspector extension directory and click on the "Select Folder "button.

Step 7: Confirm and Install

After you select an extension folder of a Google Chrome extension you're installing manually, confirm its installation for the final time and let the installation complete.

Conclusion

Here we've made a step-by-step guide on How to manually install SEO Robots Inspector extension in 2 ways. We hope this guide proves helpful.

Similar Extensions

icon

GSC Guardian Extension · Productivity 336 26 ★ 1.83MiB

icon

Extractor de entidades Extension · Productivity 336 15 ★ 45.97KiB

icon

Easy Custom Comparison Extension · Productivity 336 10 ★ 7.8KiB

icon

Seerobots Extension · Developer Tools 336 30 ★ 43.91KiB

icon

Robots Exclusion Checker Extension · Developer Tools 336 32 ★ 185KiB

icon

Better Regex in Search Console Extension · Productivity 336 7 ★ 147KiB

icon

Gandalf Extension · Productivity 336 23 ★ 237KiB

icon

Growwer | Link building and PR in seconds Extension · Productivity 336 28 ★ 366KiB

icon

Redirect Path Extension · Developer Tools 336 194 ★ 6.06MiB

icon

View Rendered Source Extension · Developer Tools 336 37 ★ 73.68KiB

icon

GSC crawl stats downloader Extension · Developer Tools 336 4 ★ 1.78MiB

icon

Hreflang Tag Checker Extension · Productivity 336 14 ★ 32.95KiB

icon

SEO Render Insight Tool Extension · Productivity 336 8 ★ 74.07KiB

icon

GMBspy Extension · Productivity 336 44 ★ 138KiB

icon

SEO on SERPs Extension · Productivity 336 7 ★ 89.21KiB

icon

Schema Builder for Structured Data Extension · Developer Tools 336 29 ★ 889KiB

icon

Make it tool Extension Extension · Productivity 336 6 ★ 67.28KiB

icon

gs location changer Extension · Developer Tools 336 50 ★ 121KiB

icon

Link Redirect Trace Extension · Developer Tools 336 346 ★ 549KiB

icon

Linkparser Extension · Developer Tools 336 21 ★ 71.54KiB

icon

Core SERP Vitals Extension · Developer Tools 336 15 ★ 20.91KiB

icon

Web Vitals Extension · Developer Tools 336 43 ★ 398KiB

icon

Show number of results and indexed pages on Google SERP (for SEO) Extension · Productivity 336 22 ★ 14.56KiB

icon

Google Search Console Enhanced Analytics Extension · Productivity 336 21 ★ 2.19MiB