Skip to content

Automatically scrape the web data of people profiles on Linkedin based on a specific search query

Notifications You must be signed in to change notification settings

boringPpl/Linkedin-profiles-scraping

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Web Scraping: Crawling Linkedin Profiles


Automatically scrape the web data of people profiles on Linkedin based on a specific search query

Tutorial:

Problem:

It takes 10s on average to skim through Linkedin profiles and copy that information into an excel sheet. To collect a large enough amount of data for analysis purposes, it will take time if done manually.

Approach to the problem:

To efficiently collect and cluster Linkedin profiles data, this scrip helps automatically scrape the web data of people profiles on Linkedin based on a specific search query and store the output in a CSV file


Sponsor

Scrape public LinkedIn profile data at scale with Proxycurl APIs.

  • Scraping Public profiles are battle tested in court in HiQ VS LinkedIn case.
  • GDPR, CCPA, SOC2 compliant
  • High rate Limit - 300 requests/minute
  • Fast APIs respond in ~2s
  • Fresh data - 88% of data is scraped real-time, other 12% are not older than 29 days
  • High accuracy
  • Tons of data points returned per profile

Built for developers, by developers.