Skip to content

Job Queue that fetches HTML requests from a specified url

Notifications You must be signed in to change notification settings

michaelgu95/JobQueue

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

JobQueue

Job Queue that fetches HTML requests from a specified url

##Fire it up

  1. Install packages
  2. Run redis server
  3. Run express server
  4. POST call to API with url to scrape(ex:google)
    • note the job id returned from call
  5. Run another cURL command using the job id from first call: $ curl -i -X GET 'http://localhost:3000/?id=(insert job id here)'

About

Job Queue that fetches HTML requests from a specified url

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published