Check robots.txt. This is an extension that helps you with SEO
With the goal of helping you visually check if the meta-robots tag is preventing the web from being crawled or indexed by search engines?
- Meta Robots tag
Any Robot Meta tag that directs the robot to “noindex”, “nofollow” or “none” will flag the Red icons,
Any meta-robots tag with \"index\", \"all\" or without the meta robots tag will be shown in green.
CHANGELOG:
0.2.0: Check meta robots tag, support popup display configuration or not.