Build me a web crawler

$10-30 USD

Closed

Posted

over 5 years ago

$10-30 USD

Paid on delivery

I'm looking for a programmer to help me build a web crawler that will work 24/7 on the cloud. A web crawler that will search an entire website to find a match for a list of words in a (text) file; the crawler will send a notification via email of found matches and their reference urls whenever a match is found. Contact me quickly if you can for details.

Project ID: 17579759

About the project

6 proposals

Remote project

Active 6 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

6 freelancers are bidding on average $53 USD for this job

@profvipabutaleb

I'm computer engineering TA with 12+ years of experience - experienced in C/C++/Java./Python programming [did many projects in scarping - crawling - built before complete search engine] I can build you a full product of web crawling that not only crawl a certain website but has a JSP interface you can enter the URL to crawl this web site for a certain name or group of names- and do possible indexing - query processing - even phrase searching or list of queries the web interface will make you to query for another list of words and you can specify the time of monitoring. and will send you the results occasionally to specified mail.

$150 USD in 1 day

5.0

(37 reviews)

4.5

@kkc264043kkc

Want to know more about it. Can do your job. These are my skills set related to Web and Web crawling Have done scraping in Nodejs, CasperJS Phantomjs, python Scrapy Framework. Have done testing and automation with selenium also. Know to deal with database like mongo, mysql, Elasticsearch. Also know to handle proxy and captcha while scrapping

$45 USD in 1 day