Skip to content

Latest commit

 

History

1 Commit

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 

Repository files navigation

This is a simple web crawler based on Scrapy framework for DNS Names collection with : 
- nameserverspy.com
- afnic.fr

Run it once a day using crontab and you will get a nice mongo collection with daily names registred (.com, .fr, etc)

Require :
- scrapy 0.14.1
- mongodb

Usage :
$ scrapy crawl nameserverspy 
$ scrapy crawl afnic


About

No description, website, or topics provided.

Resources

Stars

5 stars

Watchers

2 watching

Forks

Releases

Packages

Contributors

Languages