Web Scraping

Web Application using ReactJS 🚀🚀🚀

Demo Link's

• 👉 Web Application

• 👉 Unit Test Reports

• 👉 API Test Reports

API

A Web scraping API which accepts a URL

🔥 API Endpoint

POST  https://api.suchitrotti.com/scrape/

Body

{
    "url":"https://github.com/isuchit"
}

Response

{
    "title": "isuchit (Suchit Rotti) · GitHub",
    "description": "DevOps | AWS ☁ | React | Full Stack Developer </>. isuchit has 17 repositories available. Follow their code on GitHub.",
    "images": [
        "https://github.githubassets.com/images/search-key-slash.svg",
        "",
        "",
        "",
        "https://avatars2.githubusercontent.com/u/26110025?s=88&u=4003ef1272faa04b985f4a4890e4f1b3bfb325aa&v=4",
        "https://avatars2.githubusercontent.com/u/26110025?s=88&u=4003ef1272faa04b985f4a4890e4f1b3bfb325aa&v=4",
        "https://avatars3.githubusercontent.com/u/26110025?s=460&u=4003ef1272faa04b985f4a4890e4f1b3bfb325aa&v=4"
    ],
    "ogtitle": "isuchit - Overview",
    "ogtype": "profile",
    "ogimages": "https://avatars3.githubusercontent.com/u/26110025?s=400&u=4003ef1272faa04b985f4a4890e4f1b3bfb325aa&v=4",
    "ogurl": "https://github.com/isuchit"
}

Deployment

• Deploy by running setup.sh

  

Scripted

• All AWS recources are created using cloudformation scripts is here.

• Lambda function is in NodeJS is here.

• Unit Testing for lambda function using Chai-Mocha is here.

• API is written in OpenAPI is here.

• Shell script for deployment is here

Screenshots

• Home

  

• Unit Test NYC Report

  

• API Test Newman Report