Skip to content

sourcecode347/SitesDB

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SitesDB

Domain Database Builder

Open SitesDB Script with text editor and go to the Settings Sector and set up the ChromeDriver Path and Ensure you have installed Chrome Or Chromium to your System :

chromedriver_path='Your ChromeDriver Path Here'

To Setup SitesDB Script execute this command :

pip install requirements.txt

To use the SitesDB Script execute this Command :

python sitesdb.py -h

python sitesdb.py -c

The Python Script SitesDB Crawls Domains Names from the DuckDuckGo search engine, performs CMS Detection and imports them into a SQLite3 database.

Having a large database with Domains helps you export specific Domains (e.g. with CMS WordPress) to perform various Tests with other tools, each Domain has status=none and when exported it gets status=exported so that you don't create the same lists every time, also the export starts from the most recent Inserts.

Large databases with Domains cost money, you don't find them for free, so if you want to perform various Tests with other tools (e.g. SQLBot), then you must have built your databases.

Have a nice day & Happy Hacking :)

About

Scrapping Domains with CMS Detection and Building a Huge Database

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages