Crawler for expired domains needed
$250-750 USD
Paid on delivery
I am looking for a someone who can create a polite crawler to find expired domains.
Following functionality:
(1) Indexing domains
- Crawler crawls through the web and saves domainnames in a database
- There shall be the setting opportunity just to crawl domains with a certain ending
(2) Checking website status
- Another crawler regularly and automatically visits the domainnames saved in database
- By using HTTP-Header-Status or other ways, it shall be checked whether is domain is indexed in the nameservers
(3) Displayment of domains
- In case the domain is not in the DNS entries anymore, the pagerank of the domain is checked
- Furthermore, the validity of the pagerank is checked
- I also want the crawler to be able to run the list of domains agaist for example a moz api to get values like DA, PA, trust flow, citation flow,
PLEASE JUST BID IF YOU CAN COMPLETE FULFILL THE REQUIREMENTS!
Project ID: #5475663
About the project
6 freelancers are bidding on average $1002 for this job
My name is Duane and I am an application developer with 7 years’ experience in the IT industry. I am the project manager for a small software company Water Web Design LLC. The technologies we use are Html 5, CSS 3, C, More
