Find Jobs
Hire Freelancers

Crawler/Spider abel to detect keywords in 7000 websites

$30-250 USD

Closed
Posted over 9 years ago

$30-250 USD

Paid on delivery
Hello, We have a list of 7000 websites and we would like to check in each of them if they contain certain keywords (we do have a list). We would need to check the presence of the keywords to level 4 or 5 of the website. The output is an excel file with the list of website and corresponding keyword (1 if the keyword is present, 0 if it is not).
Project ID: 6608939

About the project

23 proposals
Remote project
Active 9 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
23 freelancers are bidding on average $166 USD for this job
User Avatar
Hello, I can do this. please show me sample of several websites and tell me how many keywords you have so I can confirm my quote
$109 USD in 10 days
5.0 (262 reviews)
8.7
8.7
User Avatar
A proposal has not yet been provided
$200 USD in 3 days
5.0 (112 reviews)
7.6
7.6
User Avatar
Hello Sr. Jorge is my name, from Argentina. I am a System Engineer with wide experience doing scrapes and related skills. Please, take a look at my Portfolio to see my last jobs. And regarding this particular one,I offer you to check as a sample, a list of first 100 websites and I will return a result as per your requirements. If case you are satisfied with the results I will offer, you could proceed to hire me then, not before. I have a tool, developed by me, to search for all over the links on each website, searching for one or more keywords there. Thanks Sr. Jorge.
$155 USD in 7 days
5.0 (219 reviews)
7.5
7.5
User Avatar
Hi, I am a professional web data scraper specialized using Python program, PHP script, .Net program, Crawler and Bot. My tool can search data and get information from Aa to Zz with an existing lists of english words. Below is the link for your reference as a sample related to my tool being developed. This demo will capture doctor's name, address, zip, phone, ratings and reviews in 4 different sites. The final output will be save in *.XLSX format or as your quirement.I can start as early possible depending on your approval and acceptance. In relation to this application, I can rest assured I will impart a high quality and reliable, efficient and accurate with the output. Give me a try and I will try to get the best results and finish the project far before the deadline. Thanks,Ferdous
$252 USD in 4 days
4.8 (238 reviews)
7.2
7.2
User Avatar
Hi: Here's a similar project that I have done before: https://www.freelancer.com/projects/Web-Search/need-list-websites-that-contain.html Please note that I have 100% completion rate and 5-star feedback on projects. Please connect with me to discuss more.
$188 USD in 7 days
4.9 (105 reviews)
6.8
6.8
User Avatar
Hello I did an almost same project last year. Please let me help you at this ............................................................... Best Regards Bill
$250 USD in 7 days
5.0 (15 reviews)
6.2
6.2
User Avatar
Hello Sir, We are a working team with excellent experienced and skilled operator with lot of experience in this segment,since last 4 years in Freelancer.com, i have gone through your project description, its really a simple task, we can make a well formatted,error free list. Sir, we are waiting for your reply for communicate also like to make a sample if you allow by a single reply. Thanks DG
$147 USD in 3 days
4.6 (152 reviews)
6.8
6.8
User Avatar
Hi, I have experience with Web Crawling. I will use ruby language and anemone or mechanize gems, I will see which one better fit your needs. I use proxy rotation, so each request is made with different IP address. Also I use asynchronous httprequest so it will crawl much faster then standard crawling. I use rubyXL gem for reading and writing to xlsx files. Just tell me do you want to search only in meta keyword tags, or you want to search keywords in content of website, in body tag? I can finish this project very fast just message me with answer. Also because this is small project, I don't need any milestone created or released until I finish all project, and I will show you how this script work. Then you will send me money and I will send you source code. You will run this script from your terminal or command prompt. And that's it. I think this is good offer for you. Thanks.
$150 USD in 10 days
4.9 (22 reviews)
6.1
6.1
User Avatar
Hi! I think that I posted a bid on your project on elance too. I have already suggested my approach but I am repeating the same here. Can we please discuss about this project? Approach to the Job: I will give you a script which will take an excel file path as input. My script will read the excel file, visit each row one by one, read the details such as website url, keywords to search etc, visit the url, look for the keyword and if it is found, it will add an indicator in the last column of that row that the keyword is present. I know you intend to highlight the row, but I am propsing another solution because it would be hard to highlight the row using a script. What I can do is, if the search is successful, it will put a "0" in the last column of that row, if it fails it will put a "1". When this data is present for all the files, you can open the excel file and sort the data based on the column added by script, so that all rows which have a "0" come at the top. It is also possible to highlight it in MS excel based on the column's value, if you want to avoid sorting. My script will also handle cases of network errors, suppose if a row fails due to network error it will run for that row again. And also if you have millions of records and you want to resume the script from a particular row number that will also be possible through my script.
$222 USD in 6 days
5.0 (6 reviews)
4.4
4.4
User Avatar
Hi, I'm web scraper developer and i can check keywords in 700 websites Please share few keywords and websites Thanks
$100 USD in 3 days
5.0 (7 reviews)
4.5
4.5
User Avatar
we are professional in this type of service we are scanning keywords from certain domains and have full report to be given like keyword and from which domain keyword found let me know if you are interested thanks
$277 USD in 3 days
5.0 (12 reviews)
4.5
4.5
User Avatar
I have gone through the description. I am very much interested to work on your project. I’ll provide you the work as per your requirement with in a particular time frame. So let’s start and finish it FAST. Tasleem Naz (Female)
$200 USD in 3 days
4.7 (58 reviews)
4.9
4.9
User Avatar
Dear Sir, I am ready to start right now. I am waiting here for you. i will show you demo such like this job. i ensure you that i will provide quality job. Please contact with me. i'm here. EVERY 1000 ENTRY ONLY $40. thanks
$40 USD in 3 days
5.0 (16 reviews)
4.3
4.3
User Avatar
I have automated web crawler to extract such info - produces an advanced database (so we can check for duplicates and come back to get changes regularly). We supply the data in Excel-compatible CSV format. Give an example website and I will return a sample of the data you want for you to try in a few hours!
$300 USD in 2 days
5.0 (1 review)
2.1
2.1
User Avatar
Hi, I am ready to perform this task. For this, I will write special python-script. But I want to clarify something: Where to look for keywords? In content of websites or meta tags?
$30 USD in 2 days
5.0 (3 reviews)
1.8
1.8
User Avatar
Hello, I am good at surfing and have good command over MS office tool. I mentioned as 5 days in this bid as I want to give you a quality of work. Please let me know if you are ok with my proposal Regards Basha
$45 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, you can consider this job done with our team, for more information for who we are or what we can do please give us a visit at dofeeds
$155 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of FRANCE
Paris, France
5.0
2
Payment method verified
Member since Oct 8, 2013

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.