Skip to content

Web scraper for Animal Crossing - New Horizons data using bs4

Notifications You must be signed in to change notification settings

sungyeonu/animal-crossing-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

animal-crossing-scraper

Python webscraper to extract various data of the game Animal Crossing - New Horizons.

Data source: https://animalcrossing.fandom.com/wiki/

Feel free to use the JSON files! Some of the pages on the wiki are incomplete, so if some data is missing please check back later.

Output

All JSON files are stored in /data

-- Completed --
/museums

  • bugs.json
  • fish.json
  • fossils.json
  • artwork.json

/characters

  • villagers.json

/flowers

  • availability.json
  • genetics_others.json
  • genetics_rose.json
  • hybridization_advanced.json
  • hybridization_simple.json

/music

-- Incomplete --
/crafting

  • tools.json
  • equipments.json
  • housewares.json
  • miscellaneous.json
  • wallMounteds.json
  • wallpaperRugsFloorings.json
  • others.json

/clothing

  • tops.json
  • bottoms.json
  • dresses.json
  • hats.json
  • accessories.json
  • socks.json
  • shoes.json
  • bags.json
  • umbrellas.json

JSON fields

Price: -1 indicates the data is not available yet.

Set Up

  1. In the animal-crossing-scraper root directory, clone the project using
git clone https://github.com/sungyeonu/animal-crossing-scraper.git
  1. Set up a virtual environment
python -m venv venv
  1. Activate the virtual environment
  • Windows: venv\Scripts\activate
  • Linux/Mac: source venv/bin/activate
  1. Install required packages
pip install -r requirements.txt

Usage

To run:

python scrapy.py

To test:

python test_scrapy.py

About

Web scraper for Animal Crossing - New Horizons data using bs4

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •  

Languages