Skip to content

Prudenceyyx/Webscrap-Database

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Webscrap-Database

Scrap content from dynamic webs and save the last to database

Database: mLab Portal: http request

Web scrapped from: Jiupai Photo Live website

Mechanism: 1.Initialize by listing all the documents from database 2.Scrap all images from Photo Live website 3.Compare image url with what is already in database 4.Save the new ones to database 5.Repeat 2-3-4 every second

Use: 1.Clone 2.npm install

About

Scrap content from dynamic webs and save the last to database

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published