This extension could be used to crawl all images of a website

Latest Version

Version
1.4
Update
January 13, 2014
Size
235KiB
Developer
Category
Users
1,000+
Rating
3.16667 ★
Manifest Version
2
Web Store Status
Languages Support
English
See more
Permissions
Tabs
Http://*/*
Https://*/*
See more

Crawler Extension

This extension could be used to browse all images of a website recursively.
As technical limitation, we can't automatically download all images into your local file system. So we choose to provide a good UI for these images within browser. In its future version, we will add functions to export data into other formats.

Version 1.1 change list:
1. category the images we got by its domain
2. add URL input box so that user can change crawl site in the manager page.
3. performance enhancement --> use lazy loading so that the image will load only when you scroll to it.
Read more

Source Manifest.json

{"update_url": "https://clients2.google.com/service/update2/crx", "background": { "page": "extension_page/background.html" }, "browser_action": { "default_icon": "icon19.png", "default_popup": "extension_page/popup.html" }, "description": "This extension could be used to crawl all images of a website", "icons": { "128": "icon128.png", "16": "icon16.png", "48": "icon48.png" }, "manifest_version": 2, "name": "Crawler", "permissions": [ "tabs", "http://*/*", "https://*/*" ], "content_security_policy": "script-src 'self' https://ssl.google-analytics.com; object-src 'self'", "version": "1.4"}
Read more

How to download and manually install Crawler extension for Chrome

Looking for a way to install Crawler extensions for Chrome, you can search for them in the Chrome Web Store, clicking the "Add to Chrome" button, and following the straightforward process.

However, you may need to install Crawler extensions manually, this article outlines two simple methods to effortlessly install Crawler extensions, whether they come as unpacked folders in compressed formats like .zip or as .crx files.

Method 1: Download Crawler extension and manually install through Drag &Drop

If you ever need to manually install a Crawler extension for Chrome, don't worry, it's a simple process. Just follow these easy steps, and you will have your extension ready to use in no time.

Step 1: Download the Crawler Extension by clicking the "Download CRX" button on the website.

Look for the Crawler extension you wish to install. Go to the website and download the Crawler extension package, which is usually a .CRX file and comes in a zipped file. Here ".crx" file is the format for Crawler extension that contains all the data.

Step 2: Extract &Arrange Files

Once the file is downloaded, extract that file into its own folder. Similarly, give that extension files a permanent home. In other words, keep it in a folder that you don't accidentally delete it because these files will be needed to make that extension work.

Step 3: Go to the Chrome Extensions Page

Open Google Chrome and in the address bar, type chrome://extensions; it will open the Google Chrome extensions page. Make sure that "My extensions" is selected in the sidebar.

Step 4: Drag and Drop the Extension

Now, go to the folder where you extracted the Crawler extension and drag &drop the extension file from there anywhere onto the extension page within Google Chrome.

Step 5: Complete the Installation

Once you drag and drop the extension file, follow the steps that Google Chrome takes you through. Similarly, if the extension file is of .crx file format, you will be required to review the permissions and then add the extension.

Now, you can manage that added extension as you would like to with any other Chrome extension that you added through Chrome Webstore. Its icon will also appear in the Google Chrome Menu on the right side of the address bar once you activate it.

Method 2: Download Crawler extension for Chrome and install in Developer Mode

This is another method to install Crawler extension manually, but the twist is that here, you install by enabling the developer mode option provided in Google Chrome. This mode is commonly used for testing extensions or running unpublished tools.

Step 1: Download the Crawler extension file

Select and download the Crawler extension by clicking the 'Download CRX' button on the website.

Step 2: Extract the downloaded contents

Convert the file to a ZIP file if it is in CRX format then extract the Crawler extension zip file or folder that you downloaded. Make sure you extract it using the same folder name and keep it safely in another folder, so you don't delete it by mistake. The extracted folder will be needed to keep your Crawler extension running.

Step 3: Open Chrome Extension Setting Page

In the address bar of Google Chrome, type chrome://extensions and open the Chrome Extension Page.

Step 4: Enable Developer Mode

After opening the Chrome Extension page, look at the top right side, and you will find the toggle option of "Developer mode."Simply enable that developer mode option.

Step 5: Load the Unpacked Extension

Once you enable the developer mode option, you will see the menu of Load Unpacked, Pack Extensions and Update. From that, select the option "Load unpacked."

Step 6: Select the Extension Folder

Once the pop-up opens upon clicking Load unpacked, select the Crawler extension directory and click on the "Select Folder "button.

Step 7: Confirm and Install

After you select an extension folder of a Google Chrome extension you're installing manually, confirm its installation for the final time and let the installation complete.

Conclusion

Here we've made a step-by-step guide on How to manually install Crawler extension in 2 ways. We hope this guide proves helpful.

Similar Extensions

icon

zzllrr Imager Geek Extension · Productivity 1,000+ 505 ★ 2.54MiB

icon

Agenty - Advanced Web Scraper Extension · Developer Tools 1,000+ 175 ★ 604KiB

icon

Link Klipper - Extract all links Extension · Productivity 1,000+ 199 ★ 990KiB

icon

Bulk Image Downloader Extension · Photos 1,000+ 294 ★ 247KiB

icon

Page Crawler Extension · Developer Tools 1,000+ 5 ★ 26.33KiB

icon

Semantic Spider Extension · Accessibility 1,000+ 3 ★ 596KiB

icon

Privacy Crawler Extension · Developer Tools 1,000+ 0 ★ 29.74KiB

icon

Link Crawler Extension · Productivity 1,000+ 0 ★ 27.53KiB

icon

Scraper Extension · Developer Tools 1,000+ 337 ★ 1.98MiB

icon

Fun Crawler Extension · Developer Tools 1,000+ 3 ★ 14.91KiB

icon

Scraper Crawler V3 Extension · Developer Tools 1,000+ 28 ★ 174KiB

icon

Examine Offline Data (Cookies, HTML5 Storage) Extension · Developer Tools 1,000+ 5 ★ 33.75KiB

icon

Recursive Extension · Productivity 1,000+ 12 ★ 1.04MiB

icon

Wild Spider Extension · Productivity 1,000+ 1 ★ 121KiB

icon

IMG inspector Extension · Accessibility 1,000+ 78 ★ 30.17KiB

icon

Bulk Image Downloader Extension · Productivity 1,000+ 442 ★ 42.66KiB

icon

zzllrr Imager Geek(Lite) Extension · Photos 1,000+ 107 ★ 2.54MiB

icon

Image Link Grabber Extension · Productivity 1,000+ 21 ★ 607KiB

icon

Robots vs Humans Extension · Developer Tools 1,000+ 23 ★ 203KiB

icon

Image Download Extension · Accessibility 1,000+ 68 ★ 86.52KiB

icon

JScript tricks Extension · Developer Tools 1,000+ 50 ★ 340KiB

icon

ScreenScraper Extension · Developer Tools 1,000+ 34 ★ 135KiB

icon

Bishop Vulnerability Scanner Extension · Developer Tools 1,000+ 12 ★ 198KiB

icon

OneClick Picsaver Extension · Photos 1,000+ 75 ★ 68.89KiB

User reviews

icon

Matt C (ID: 0000000b621d3a6c) Voted 1 ★ - Updated 03/22/2018 Only gives images, no addresses

icon

Mark Sandland (ID: 00000031fdcc8564) Voted 2 ★ - Updated 03/15/2018 Gets stuck crawling my test site.

icon

Johannes Schneider (ID: 000000c560c50586) Voted 2 ★ - Updated 09/21/2014 Got stuck... Still no results after 10min of waiting though site has only few images.

icon

Ferrum Noricum (ID: 0000005d2be4a897) Voted 2 ★ - Updated 03/28/2014 This extension has serious problems in getting the right site. Especially when running with multiple windows open, it takes the last active tab from (as it seems) the first chrome window but not the one invoked from. Does not show errors, does not traverse folders, does not retrieve anything else, does not allow filtering, dows not allow saving ALL images at once, etc. Basically it just does what you already have in the developer window under resources/images. Long way to go.

icon

Michael Reiche (ID: 000000ab8f073ef2) Voted 2 ★ - Updated 08/21/2013 Does not find all images on my testsite. Console window reveals that it tries to traverse mailto: urls from href="mailto:....". Which happens to be the last message on each run. But also tries to fetch some images from urls of the form "chrome-extension://pdhedahnmicgeobhejclpbogemgkfpdo/sch-base-portlet/resize?w=100&h=100&img=36115003763.jpg", where /sch-base.... is the real image url.