Closed

Create a script to take a list of domains and pull stats on them via API ([login to view URL])

Project summary/goal. We are processing domains in bulk for spam, we check tens of thousands of domains per day. We want to quickly find which domains have spam sites linking to them by checking the incoming link anchors.

When we have that data, we want to check the anchors against a keyword blacklist and remove the domains that have anchors that contain keywords from the blacklist.

==========

We want to create a web script that will take a list of domains and send them to the [login to view URL] API for processing.

API Docs: [login to view URL]

We want to send the domains and pull back the anchors associated for each domain. Specifically this API call - [login to view URL]

Once we have the data back, we want the script to take a list of keywords we provide and filter the anchors to see which keywords.

We will want to use a simple web interface, where we can provide a list of domains and a set of blacklist keywords. The script will send the domains for processing and then process the results into 2 csv files.

Output 1: A csv file with all non blacklist keyword domains and anchors in 2 columns

Output 2: A csv file with all blacklisted keyword domains and anchors in 2 columns

The interface would have a project list where we can create a project and start it, and also a settings page where we can update the blacklist keywords.

We can use a web template like this: [login to view URL] - we’ve used it extensively in the past already.

Thanks!

Skills: Web Scraping, Web API, PHP, Python

See more: asp script list directory content, create drop list wordpress, linux server script list, create product list excel format, script create filesfrom list, script list items ebay, write script list domain users login days months, create task list php, script pull stats database, example create script google provisioning api, php script create mail list, resellerclub api list domains, list domains script, php create wish list script, google maps api create script, create price list php script, cpanel api list domains

About the Employer:
( 194 reviews ) Lilydale, Australia

Project ID: #24692017

17 freelancers are bidding on average $527 for this job

mhmhz

Hi I can implement a desktop tool if this acceptable Thanks

$800 USD in 7 days
(177 Reviews)
7.9
jaylancer43

Hello Sir, I can build you a python script that will check domain against majestic API and can further checking keywords in response. My name is Jay and I am Excel and Python Expert on freelancer.com and have been f More

$555 USD in 3 days
(132 Reviews)
7.5
ineedWorkJob

Greetings sir, I have read your project details and i will develop the web script to check domain for span and create two csv file based on [login to view URL] response. Sir, i can delive More

$500 USD in 1 day
(145 Reviews)
6.8
fhasanbd

I am a professional web data scraper specialized using Python program, PHP script, .Net program, Crawler and Bot. My tool can search data and get information from Aa to Zz with an existing lists of english words.

$500 USD in 7 days
(166 Reviews)
7.0
Jee1980

Hello I read your description carefully as well as read about [login to view URL] basically , I have been working on API integration based on PHP/Python/Node for 5 years. I am familiar with PHP More

$400 USD in 10 days
(13 Reviews)
5.0
meladbadder

Hi, I am an expert in web scraping. I can create a script to take a list of domains and pull stats on them via API through my experience of the past. I worked on projects like your project. I will finish more quickly t More

$250 USD in 1 day
(16 Reviews)
4.9
AITSoft

Hi, How are you? Upon reading brief details I believe its a doable job I have great experience doing projects with PHP, Python, Web Scraping and Web API. I am confident about getting this done. While I believe we need More

$750 USD in 11 days
(24 Reviews)
4.6
ssuet123

Hey there, Hope you are doing fine. I am a full-stack web developer with more than 7 years of experience. I can create a web script for you that will take a list of domains and send them to the [login to view URL] API for pr More

$250 USD in 1 day
(52 Reviews)
4.4
uridevman

Hello, I can implement website which produces csv result of blacklist and nonblacklist. What I understand from your requirement is that you need to make check every websites provided from user if they contain certain More

$500 USD in 7 days
(4 Reviews)
3.6
webbakervij

I Hope you are doing well! Firstly, I'd like to make familiar with my background so you can check my work out. Expert in BOTH Backend and Front-end Programming, PHP - OOP, MVC, REST API, HTML/CSS/JAVASCRIPT, Codeigni More

$500 USD in 5 days
(2 Reviews)
3.0
harunnizam

Hello, sir. I have read your project requirements carefully. i am very familiar with API so I can do your projects perfectly as you wish. I have ever done many api projects before like yours. So I have enough experienc More

$500 USD in 7 days
(5 Reviews)
3.2
valerykrapiv

hello. i am python and web scraping expert. I've read your project description and would like to know more about the project and goals. i can build your project with python. i want to work with u on your project. regar More

$750 USD in 10 days
(5 Reviews)
3.7
ITL2020

Dear Recruiter, Greetings. I have gone through the project with title: ‘Create a script to take a list of domains and pull stats on them via API ([login to view URL])’. I am a Full Stack Developer with 5+ years of experienc More

$400 USD in 5 days
(2 Reviews)
2.2
AlwaysDeliever

I'm Aftab from Australia. I'm pretty happy to bid on this interesting project. I have solid foundation on Python and other skills. I read your description carefully and I think that I am the developer you are looking f More

$400 USD in 3 days
(0 Reviews)
0.0
tulikapriyadars1

hi, we have 12+ years experienced in this so you can also check our website www.vrickson.com. hope you ll hire me . ty Tulika

$710 USD in 20 days
(0 Reviews)
0.0
AliHajiabadi

Dear madam/sir, I am an experienced programmer with more than 12 years of experience. I have developed several web-scraping projects, mainly on Python using Selenium. I can help you with the project. Here is the detai More

$499 USD in 7 days
(0 Reviews)
0.0
chadhabh

I am a 6+ years experienced python developer. I can get this up and running with tests and all in a weeks time.

$694 USD in 5 days
(0 Reviews)
0.0