I want to crawl all the wordpress blogs. Is there any quick approach to list all the secondary domain names under wordpress.com? For example http://developer.wordpress.com/
If we can get the list of all secondary domain address, it should be easy and quick to crawl all the dataset.
So can we do by 1) dns lookup for all secondary domain names for a website. 2) or by other hacking techniques?
Thank you for the answer to this question!
You can easily find the subdomain using google dorks on some online apps that do the realtime search like http://www.iseebug.com/find-sub-domain-online-search-domain/
Also the online crawler like http://iseebug.com/sandVox/