Web scraping and database website

Closed Posted Dec 19, 2015 Paid on delivery
Closed Paid on delivery

I need help with building a website that lists expired web domains.

Requirements:

1. Scrape the website Expired domains dot net once every day and identify deleted domains. If you know a way to crawl the web and identify deleted domains, that’s even better.

2. Store new records in a table

3. Test each domain every day if it is available to register on the domain registrars (I will not provide details how to check, this is something you need to be able to figure out)

4. Tag each domain that is available

5. Check the Trust Flow and the Citation Flow of each domain. Store the information in the table (I will not have a Majestic account with API:s, you need to figure out a way to check these metrics at scale in some way, maybe on a TF CF checker at the web that can handle large volumes)

6. Publish the information on a table on a Wordpress website in a similar way as information is published at expired domains dot net. Table should be updated once every day. Only domains that are tagged as available for registration

It should be possible to filter and sort on each column in the table. The default number of rows shown should be 20, but itshould be possible to select 20, 50 or 100 rows.

When bidding describe your previous experience in this field.

l

Database Development PHP Software Architecture Web Scraping

Project ID: #9157167

About the project

7 proposals Remote project Active Jan 25, 2016

7 freelancers are bidding on average $125 for this job

Yknox

Hello. I am interested in your project. I have a lot of experiences in web scraping . Please check my portfolio and working history. if u hire me, u could come up with good results at fair price. Best regards. Yk More

$154 USD in 3 days
(534 Reviews)
8.6
mirniyazuddin92

Dear Sir/Ma'am, I am a Web research, Data Entry & Webs Scrapping expert. I checked and understood your requirements. I can handle this job very well to your appreciation. I can find and extract the information More

$200 USD in 3 days
(107 Reviews)
6.7
diamond247

Hello Sir, We are a team (19 operator and 2 Quality checker)here from last 4 year giving all research service world wide with best quality output , I have gone through your project description, It is really a intere More

$30 USD in 3 days
(106 Reviews)
6.4
mehedi276

"Rate and duration will be fixed on discussion" Dear Hiring Manager, I have gone through your job posting and become very much interested to work with you. I am an expert in these fields. I have already completed se More

$144 USD in 3 days
(59 Reviews)
5.6
ExpertScraper1

I have already scraping scripts to scrape any websites. I can provide web scraping, data scraping, web data extraction, data mining services from online web resources.

$100 USD in 3 days
(54 Reviews)
4.8
luellkearl

Hello, Most of my projects here are about web scraping. I have created: - Auto register of domain name without using API. - Proxy to another website and output with better design and responsive. - File/Video upl More

$200 USD in 7 days
(16 Reviews)
4.0
adilsyed123

Expert here to do and complete this project professionally and quickly, I have done similar projects, I can do trial work before hire me sir , will wait for your reply, Thanks, Syed

$45 USD in 1 day
(5 Reviews)
2.9