remotal.io

Web scrapping in browser made easy for developers - by Remotal

Latest Version

Version

2.0.1

Update

July 15, 2020

Size

18.55MiB

Developer

remotal.io

WebScrapper for developers - Free - Remotal Extension

WebScrapper by Remotal.io.
Build your scrapper to scrap any website (for Javascript developers).

You can:
- Scrap a unlimited number of page
- Export and import projects
- Browse pages navigation lists (works with: ajax refresh, page reload and partial reload)
- Handle captcha or 2Factor or any situation that needs a manual actions, wait for user interaction to solve it and resuming scrapping
- Send data to your server or save it locally in a file

v2.0.1
- Fixes critical bug preventing the extension to work

V2.0.0
- Scrap an URL several times with different parameters
- Parameters for URLs can be static or dynamic by getting them from your server right before scrapping a page
- Using a switch, you can decide to automatically send the data to your server after each iteration of your scrapper
- You can schedule your projects to run at different interval automatically

Documentation : https://github.com/remotal-io/webscrapper-free
Examples: https://github.com/remotal-io/webscrapper-free/tree/master/examples

If you find any issue, please submit it here https://github.com/remotal-io/webscrapper-free/issues for resolving
If you need help, join us here: https://gitter.im/webscrapper-free/community

Source Manifest.json

{"update_url": "https://clients2.google.com/service/update2/crx", "manifest_version": 2, "name": "WebScrapper for developers - Free - Remotal", "description": "Web scrapping in browser made easy for developers - by Remotal", "version": "2.0.1", "browser_action": {}, "icons": { "16": "icons/favicon-16x16.png", "32": "icons/favicon-32x32.png", "48": "icons/favicon-48x48.png", "128": "icons/favicon-128x128.png", "192": "icons/favicon-192x192.png", "512": "icons/favicon-512x512.png" }, "background": { "scripts": [ "backgroundScripts/helper.js", "backgroundScripts/messageHandler.js", "backgroundScripts/pageLoadedRunner.js", "backgroundScripts/portManager.js", "backgroundScripts/localStorageReceiver.js", "backgroundScripts/inject.js", "backgroundScripts/state.js", "backgroundScripts/log.js", "backgroundScripts/v1/scriptRunnerV1.js", "backgroundScripts/v1/runnerV1.js", "backgroundScripts/v2/ajv-6.12.2.min.js", "backgroundScripts/v2/urls-json-schema.js", "backgroundScripts/v2/FileSaver-2.0.2.min.js", "backgroundScripts/v2/scheduler.js", "backgroundScripts/v2/historyRunner.js", "backgroundScripts/v2/workerRunner.js", "backgroundScripts/v2/scriptRunnerV2.js", "backgroundScripts/v2/runnerV2.js", "backgroundScripts/runnerSelector.js", "backgroundScripts/background.js" ], "persistent": true }, "content_security_policy": "script-src 'self' 'unsafe-eval'; object-src 'self'; script-src-elem 'self' https://cdn.lr-ingest.io; ", "web_accessible_resources": [ "ui/dist/index.html" ], "content_scripts": [ { "matches": [""], "js": ["contentScripts/cs.js"] } ], "externally_connectable": { "matches": ["http://localhost/*"] }, "permissions": [ "tabs", "storage", "unlimitedStorage", "", "identity", "identity.email", "alarms" ]}

Download CRX(18.55MiB)