Skip to content

This is a website extract all URLs scraper built using javascript(nodejs)

Notifications You must be signed in to change notification settings

securi3ytalent/JS_URL_Finder

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FIND All HIDDEN LINKS FORM Website

This is a website extract all URLs scraper built using javascript(nodejs)

Authors

Haw to use

Deployment

  1. Fast need to your device node js install.
  2. Install the required dependencies by running.
  npm install axios fs cheerio readline
  1. Run the script using Node.js (node script.js), where script.js is the name of the file containing the code.
  node fileExe-finder.js
  node URL-finder.js
  1. Enter the website URL when prompted. example
  https://example.com

Find the endpoint

  .html, .css, .js, .json, .png, .jpg, .jpeg, .gif, .svg, .ico, .mp3, .mp4, .ogg, .webm, .pdf, .doc, .docx, .xls, .xlsx, .ppt, .pptx, .ttf, .otf, .woff, .zip, .tar, .gz , .rar, .csv, .xml, .php, .py, .rb, .scss, .sass, .less, .sql, .ini, .txt, .md