Scrape shit for use in YGO-EDS
Yu-Gi-Oh Scraper Extension Extension
This is a scraper extension for getting Booster Pack and Card info from https://yugioh.fandom.com/wiki for the GBA game, Yu-Gi-Oh! The Eternal Duelist Soul. To scrape a page, go to a booster pack page for The Eternal Duelist Soul, i.e. https://yugioh.fandom.com/wiki/Dark_Magician_(EDS-BP) and click the \"Scrape Page\" button. The button will be disabled after being clicked, and an alert will display once all the card data for the selected booster has been collected. Expect a few moments for packs to be scraped. Users will get a loading wheel and the screen will become opaque during the scraping process. By clicking on the extension popup in the extensions bar, users can see what packs are left to scrape prior to being able to download all the scraped data to a local JSON file via the \"Download Contents\" button.
If at any time a user would like to undo the work they have done, they may click \"Clear Storage\" in the extension popup.
Note: this is a for-fun extension, developed to learn programming extensions and to create a content database for another project.
Users can follow the Git Repo at: https://github.com/jakehein/Scraper for further updates on this.
Furthermore, users interested in learning about the main project this was made for can learn more by following: https://github.com/jakehein/yugioh.
Note: In order to click the \"Download Contents\" button, the user must scrape ALL BOOSTER PACKS LISTED, including the Special Packs, i.e. 'Weekly Yu-Gi-Oh!', 'Yu-Gi-Oh! Magazine', and the 'Grandpa Cup'. Failing to do so will prevent the user from being able to download the incomplete data.
The URLs needed to be scraped are as follows:
https://yugioh.fandom.com/wiki/Dark_Magician_(EDS-BP)
https://yugioh.fandom.com/wiki/Mystical_Elf_(EDS-BP)
https://yugioh.fandom.com/wiki/Red-Eyes_B._Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Cyber_Harpie_(EDS-BP)
https://yugioh.fandom.com/wiki/Gate_Guardian_(EDS-BP)
https://yugioh.fandom.com/wiki/Great_Moth_(EDS-BP)
https://yugioh.fandom.com/wiki/Launcher_Spider_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue-Eyes_White_Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Exodia_(EDS-BP)
https://yugioh.fandom.com/wiki/Relinquished_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue-Eyes_Toon_Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Buster_Blader_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue-Eyes_Ultimate_Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Black_Luster_Soldier_(EDS-BP)
https://yugioh.fandom.com/wiki/Judge_Man_(EDS-BP)
https://yugioh.fandom.com/wiki/Tiger_Axe_(EDS-BP)
https://yugioh.fandom.com/wiki/Gemini_Elf_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue_Millenium_Puzzle_(EDS-BP)
https://yugioh.fandom.com/wiki/Green_Millenium_Puzzle_(EDS-BP)
https://yugioh.fandom.com/wiki/Millenium_Eye_(EDS-BP)
https://yugioh.fandom.com/wiki/Garoozis_(EDS-BP)
https://yugioh.fandom.com/wiki/Battle_Ox_(EDS-BP)
https://yugioh.fandom.com/wiki/Multi-colored_Millenium_Puzzle_(EDS-BP)
https://yugioh.fandom.com/wiki/Weekly_Yu-Gi-Oh!
https://yugioh.fandom.com/wiki/Yu-Gi-Oh!_Magazine
https://yugioh.fandom.com/wiki/Grandpa_Cup
Read more
If at any time a user would like to undo the work they have done, they may click \"Clear Storage\" in the extension popup.
Note: this is a for-fun extension, developed to learn programming extensions and to create a content database for another project.
Users can follow the Git Repo at: https://github.com/jakehein/Scraper for further updates on this.
Furthermore, users interested in learning about the main project this was made for can learn more by following: https://github.com/jakehein/yugioh.
Note: In order to click the \"Download Contents\" button, the user must scrape ALL BOOSTER PACKS LISTED, including the Special Packs, i.e. 'Weekly Yu-Gi-Oh!', 'Yu-Gi-Oh! Magazine', and the 'Grandpa Cup'. Failing to do so will prevent the user from being able to download the incomplete data.
The URLs needed to be scraped are as follows:
https://yugioh.fandom.com/wiki/Dark_Magician_(EDS-BP)
https://yugioh.fandom.com/wiki/Mystical_Elf_(EDS-BP)
https://yugioh.fandom.com/wiki/Red-Eyes_B._Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Cyber_Harpie_(EDS-BP)
https://yugioh.fandom.com/wiki/Gate_Guardian_(EDS-BP)
https://yugioh.fandom.com/wiki/Great_Moth_(EDS-BP)
https://yugioh.fandom.com/wiki/Launcher_Spider_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue-Eyes_White_Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Exodia_(EDS-BP)
https://yugioh.fandom.com/wiki/Relinquished_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue-Eyes_Toon_Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Buster_Blader_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue-Eyes_Ultimate_Dragon_(EDS-BP)
https://yugioh.fandom.com/wiki/Black_Luster_Soldier_(EDS-BP)
https://yugioh.fandom.com/wiki/Judge_Man_(EDS-BP)
https://yugioh.fandom.com/wiki/Tiger_Axe_(EDS-BP)
https://yugioh.fandom.com/wiki/Gemini_Elf_(EDS-BP)
https://yugioh.fandom.com/wiki/Blue_Millenium_Puzzle_(EDS-BP)
https://yugioh.fandom.com/wiki/Green_Millenium_Puzzle_(EDS-BP)
https://yugioh.fandom.com/wiki/Millenium_Eye_(EDS-BP)
https://yugioh.fandom.com/wiki/Garoozis_(EDS-BP)
https://yugioh.fandom.com/wiki/Battle_Ox_(EDS-BP)
https://yugioh.fandom.com/wiki/Multi-colored_Millenium_Puzzle_(EDS-BP)
https://yugioh.fandom.com/wiki/Weekly_Yu-Gi-Oh!
https://yugioh.fandom.com/wiki/Yu-Gi-Oh!_Magazine
https://yugioh.fandom.com/wiki/Grandpa_Cup
Source Manifest.json
{"update_url": "https://clients2.google.com/service/update2/crx",\t"name": "Yu-Gi-Oh Scraper Extension",\t"description": "Scrape shit for use in YGO-EDS",\t"version": "1.0.0",\t"manifest_version": 3,\t"action": {\t\t"default_popup": "scraper.html",\t\t"default_icon": "puzzle-image.png"\t},\t"background": {\t\t"service_worker": "background.js"\t},\t"content_scripts": [\t\t{\t\t\t"matches": [\t\t\t\t"https://yugioh.fandom.com/wiki/*(EDS-BP)",\t\t\t\t"https://yugioh.fandom.com/wiki/Weekly_Yu-Gi-Oh!",\t\t\t\t"https://yugioh.fandom.com/wiki/Yu-Gi-Oh!_Magazine",\t\t\t\t"https://yugioh.fandom.com/wiki/Grandpa_Cup",\t\t\t\t"https://yugioh.fandom.com/wiki/Gallery_of_Yu-Gi-Oh!_The_Eternal_Duelist_Soul_cards"\t\t\t],\t\t\t"js": ["content-script.js"],\t\t\t"run_at": "document_end",\t\t\t"all_frames": false\t\t}\t],\t"permissions": ["storage"],\t"icons": {\t\t"16": "puzzle-image.png",\t\t"48": "puzzle-image.png",\t\t"128": "puzzle-image.png"\t}}
Read more