GitHub - ssharmapavitra/webcrawler: Crawler is a C++ & Node.js application that allows you to crawl web pages, save them locally, and extract hyperlinks from the page body. It provides a simple command-line interface where you can enter the starting URL and specify the maximum number of crawls. The crawler follows the hyperlinks recursively, saves the web pages in specified directo

Name		Name	Last commit message	Last commit date
FileHandler		FileHandler
HttpRequests		HttpRequests
dataStructure		dataStructure
hyperLinkExtractor		hyperLinkExtractor
plan		plan
.gitattributes		.gitattributes
.gitignore		.gitignore
Crawler.cpp		Crawler.cpp
main.cpp		main.cpp

About

Crawler is a C++ & Node.js application that allows you to crawl web pages, save them locally, and extract hyperlinks from the page body. It provides a simple command-line interface where you can enter the starting URL and specify the maximum number of crawls. The crawler follows the hyperlinks recursively, saves the web pages in specified directo

cheerio-html-parser command-line crawling file-system-operations http-requests hyperlink-extraction nodejs offline-web-access recursive-crawling web-crawler web-scraping

Activity

2 stars

1 watching

0 forks

Report repository