Skip to content

๐Ÿšง Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node x Express

License

Notifications You must be signed in to change notification settings

rdwz/complete-website-downloader

ย 
ย 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

Complete Website Downloader ๐Ÿ’พ

Download the complete source code of any website (including all assets) ๐Ÿ”จ.

๐Ÿ‘‰ Live Demo: getwebsite.onrender.com

enter image description here

CodeQL

Description ๐Ÿ“’

Website downloader works with wget and archiver to download all websites assets and compress then sends it back to the user through socket channel

wget params the being used

wget --mirror --convert-links --adjust-extension --page-requisites --no-parent http://example.org

Explanation of the various flags

  • --mirror โ€“ Makes (among other things) the download recursive.
  • --convert-links โ€“ convert all the links (also to stuff like CSS stylesheets) to relative, so it will be suitable for offline viewing.
  • --adjust-extension โ€“ Adds suitable extensions to filenames (html or css) depending on their content-type.
  • --page-requisites โ€“ Download things like CSS style-sheets and images required to properly display the page offline.
  • --no-parent โ€“ When recursing do not ascend to the parent directory. It useful for restricting the download to only a portion of the site

Deploy on cloud providers

Run on Replit Remix on Glitch Deploy on Railway Deploy to Cyclic Deploy to Koyeb Deploy to Render

How to run it ๐Ÿค”

  • git clone https://github.com/rdwz/Website-downloader.git
  • cd website-downloader
  • $ npm install
  • $ npm start
  • http://localhost:3000/

How To Contribute

  • Open Issue(s) with any bugs you notice.
  • Please create Pull Requests if you think it would be an added value towards our program.

Liked it ? You can buy a coffee

Donate

About

๐Ÿšง Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node x Express

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Languages

  • JavaScript 64.3%
  • HTML 29.7%
  • CSS 3.5%
  • Handlebars 2.5%