Scrape shit for use in YGO-EDS

Latest Version

Version
1.0.0
Update
December 17, 2022
Size
370KiB
Developer
Category
Users
21
Rating
0 ★
Manifest Version
3
Web Store Status
Languages Support
English (United States)
See more
Permissions
Storage
See more

Yu-Gi-Oh Scraper Extension Extension

This is a scraper extension for getting Booster Pack and Card info from https://yugioh.fandom.com/wiki for the GBA game, Yu-Gi-Oh! The Eternal Duelist Soul. To scrape a page, go to a booster pack page for The Eternal Duelist Soul, i.e. https://yugioh.fandom.com/wiki/Dark_Magician_(EDS-BP) and click the \"Scrape Page\" button. The button will be disabled after being clicked, and an alert will display once all the card data for the selected booster has been collected. Expect a few moments for packs to be scraped. Users will get a loading wheel and the screen will become opaque during the scraping process. By clicking on the extension popup in the extensions bar, users can see what packs are left to scrape prior to being able to download all the scraped data to a local JSON file via the \"Download Contents\" button.
If at any time a user would like to undo the work they have done, they may click \"Clear Storage\" in the extension popup.
Note: this is a for-fun extension, developed to learn programming extensions and to create a content database for another project.
Users can follow the Git Repo at: https://github.com/jakehein/Scraper for further updates on this.
Furthermore, users interested in learning about the main project this was made for can learn more by following: https://github.com/jakehein/yugioh.

Note: In order to click the \"Download Contents\" button, the user must scrape ALL BOOSTER PACKS LISTED, including the Special Packs, i.e. 'Weekly Yu-Gi-Oh!', 'Yu-Gi-Oh! Magazine', and the 'Grandpa Cup'. Failing to do so will prevent the user from being able to download the incomplete data.

The URLs needed to be scraped are as follows:
https://yugioh.fandom.com/wiki/Dark_Magician_(EDS-BP)
https://yugioh.fandom.com/wiki/Mystical_Elf_(EDS-BP)
https://yugioh.fandom.com/wiki/Red-Eyes_B._Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Cyber_Harpie_(EDS-BP)
https://yugioh.fandom.com/wiki/Gate_Guardian_(EDS-BP)
https://yugioh.fandom.com/wiki/Great_Moth_(EDS-BP)
https://yugioh.fandom.com/wiki/Launcher_Spider_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue-Eyes_White_Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Exodia_(EDS-BP)
https://yugioh.fandom.com/wiki/Relinquished_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue-Eyes_Toon_Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Buster_Blader_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue-Eyes_Ultimate_Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Black_Luster_Soldier_(EDS-BP)
https://yugioh.fandom.com/wiki/Judge_Man_(EDS-BP)
https://yugioh.fandom.com/wiki/Tiger_Axe_(EDS-BP)
https://yugioh.fandom.com/wiki/Gemini_Elf_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue_Millenium_Puzzle_(EDS-BP)
https://yugioh.fandom.com/wiki/Green_Millenium_Puzzle_(EDS-BP)
https://yugioh.fandom.com/wiki/Millenium_Eye_(EDS-BP)
https://yugioh.fandom.com/wiki/Garoozis_(EDS-BP)
https://yugioh.fandom.com/wiki/Battle_Ox_(EDS-BP)
https://yugioh.fandom.com/wiki/Multi-colored_Millenium_Puzzle_(EDS-BP)
https://yugioh.fandom.com/wiki/Weekly_Yu-Gi-Oh!
https://yugioh.fandom.com/wiki/Yu-Gi-Oh!_Magazine
https://yugioh.fandom.com/wiki/Grandpa_Cup
Read more

Source Manifest.json

{"update_url": "https://clients2.google.com/service/update2/crx","name": "Yu-Gi-Oh Scraper Extension","description": "Scrape shit for use in YGO-EDS","version": "1.0.0","manifest_version": 3,"action": {"default_popup": "scraper.html","default_icon": "puzzle-image.png"},"background": {"service_worker": "background.js"},"content_scripts": [{"matches": ["https://yugioh.fandom.com/wiki/*(EDS-BP)","https://yugioh.fandom.com/wiki/Weekly_Yu-Gi-Oh!","https://yugioh.fandom.com/wiki/Yu-Gi-Oh!_Magazine","https://yugioh.fandom.com/wiki/Grandpa_Cup","https://yugioh.fandom.com/wiki/Gallery_of_Yu-Gi-Oh!_The_Eternal_Duelist_Soul_cards"],"js": ["content-script.js"],"run_at": "document_end","all_frames": false}],"permissions": ["storage"],"icons": {"16": "puzzle-image.png","48": "puzzle-image.png","128": "puzzle-image.png"}}
Read more

Similar Extensions

icon

Yu-Gi-Oh! Deck Downloader Extension · Productivity 21 3 ★ 616KiB

icon

DuelingNexus Start-Hand Simulator Extension · Fun 21 1 ★ 56.59KiB

icon

Deck transfer for Yu-Gi-Oh! Master Duel Extension · Fun 21 4 ★ 24.84KiB

icon

Scrolling Time Guardian Extension · Social & Communication 21 22 ★ 107KiB

icon

Decklist Auto-Filler Extension · Fun 21 6 ★ 32.11KiB

icon

Shein Reviews Extractor - Scrape Data to CSV Extension · Shopping 21 7 ★ 2.38MiB

icon

Steam Review Summarizer Extension · Productivity 21 10 ★ 70.36KiB

icon

Job Arranger (Linkedin,Indeed,Glassdoor,...) Extension · Productivity 21 0 ★ 991KiB

icon

YU-GI-OH! New Tab Extension · Fun 21 1 ★ 1.37MiB

icon

Soc-Car Extension · Fun 21 3 ★ 116KiB

icon

YuGiOh Quick Search Extension · Productivity 21 0 ★ 27.1KiB

icon

Weblin Extension · Social & Communication 21 6 ★ 1.27MiB

icon

PVR-zPVR-Viewer Extension · Developer Tools 21 2 ★ 27.4KiB

icon

Yu-Gi-Oh-Deck-Downloader Extension · Productivity 21 17 ★ 128KiB

icon

PDF editor Form 119 UKR Posta Extension · Productivity 21 4 ★ 591KiB

icon

Get Link : Connecting You Extension · Social & Communication 21 7 ★ 968KiB

icon

MasterDuelMeta Assistant Extension · Fun 21 12 ★ 9.07KiB

icon

Minecraft Block Fall Html5 Extension · Fun 21 2 ★ 31.31KiB

icon

YTQ - YouTube Quality Selector Extension · Social & Communication 21 3 ★ 207KiB

icon

Card Image for Yu-Gi-Oh! Card Wiki Extension · Productivity 21 3 ★ 8.58KiB

icon

Yooz - Advanced AI Writer Extension · Productivity 21 22 ★ 231KiB

icon

Yellow Pages Scraper | Yellow Tools Extension · Productivity 21 12 ★ 908KiB

icon

Comment Wizard Extension · Productivity 21 17 ★ 619KiB

icon

Stickman Hero Game Extension · Fun 21 0 ★ 650KiB