Find Jobs
Hire Freelancers

Scrappy developer for web project

$70-200 USD

Completed
Posted over 4 years ago

$70-200 USD

Paid on delivery
We are seeking to develop a research tool in Scrappy that would instruct Google to search particular sites, seeking particular terms. We have a list of about 200 websites and we want to crawl the sites looking for articles with the keywords and -- if possible -- capturing the articles, links to the pages or both - in a directory or list. We are seeking an experienced Scrappy developer to make this re-usable tool for us, post it to Scrappy and instruct us on its use.
Project ID: 20934922

About the project

28 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hello, This can't be obtained using scrapping method, even if you do google will continue to block frequently. I'll develop this project using google search api. Per day 100 query is allowed in google api for free, 1000 query costs $5 per day maximum 10000 queries are allowed in a day. By pulling google results we can filter required site results into your database. I can get all this done for you if you are interested. Thank you, Karthik
$150 USD in 10 days
4.9 (104 reviews)
6.1
6.1
28 freelancers are bidding on average $158 USD for this job
User Avatar
Hello. I have rich experience with building web scrapping tool reusable using python or Node.js. I am very clear what you want, Could you share me the list of your target websites? I am a serious bidder. As a web expert, I have strong skills for 7 more than years. I hope to work with you because my skill set is suitable for your project. Will wait patiently for your favorable reply. Thank you.
$300 USD in 7 days
5.0 (75 reviews)
7.6
7.6
User Avatar
Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
$200 USD in 5 days
5.0 (132 reviews)
7.4
7.4
User Avatar
Dear Client I've read your specification carefully and I'm very interested in your job. I have rich experience of web scraping. I ensure high quality and deadline. I would like to have a detailed conversation with you regarding this project to see where we can fit in. Thanks for taking the time to read my proposal. I am ready to begin immediately. Kind regards, Pavel
$200 USD in 7 days
4.9 (99 reviews)
7.0
7.0
User Avatar
Hi, there. My name is Lee, and I have 6+ years of experiences in developing websites using PHP, MySQL, HTML & several frameworks. I read your job description, and I am interested in your project. As a dedicated full stack developer, I think I can satisfy you by completing your project in high quality in deadline. I am free now, I can start to work in your project immediately. I would love to have an opportunity to discuss with you for further details. Best regards.
$135 USD in 7 days
5.0 (42 reviews)
6.6
6.6
User Avatar
Hi there, I’ve checked the project details and I can do this project perfectly. I have huge experience in working with these projects. If you need sample work just ping me. Waiting for your quick reply. Look forward to hearing from you soon. Best Regards
$200 USD in 7 days
4.9 (105 reviews)
6.4
6.4
User Avatar
Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less ,,,,,,,,,,,,. , ,,,,,,,,, Read Less
$200 USD in 7 days
4.9 (99 reviews)
5.8
5.8
User Avatar
Hello. I read your requirement carefully. I'm very interested your project. I'm talented python and scraping developer. If you assign to me this project, you can get a cool result. please contact me. thanks. best requards.
$135 USD in 7 days
5.0 (19 reviews)
5.7
5.7
User Avatar
Hello, i'm experienced with Python and Scrapy. I have built a bot to scrape fact finding websites, another bot to scrape german governance websites and i'm currently building an amazon product scraper. In case you're interested in my assistance, let me know - i'm happy to help! Best, Jo Bergs
$200 USD in 4 days
5.0 (30 reviews)
5.9
5.9
User Avatar
Thank you for your post, sir. I have a good chance of bidding your project. I have good experience of data scraping from some websites. For example, from Amazon site, I have ever scrapped the products. Such as name, price, image url, asin etc... Total counts 20000+ Here, I used beautiful soup and selenium. Also, it is the most important that we have to think about the blocking. To avoid it, I used some ways such as IP rotation and fake user agents. I want to share opinions about your project by chat. So I want to get some issues from your project and to discuss about that with you. If you hire me, I will do the best for you. I want to keep in touch with you in a short time. I will wait for your response. Best Regards. https://www.freelancer.com/projects/web-scraping/Scrape-coupon-code-website/reviews https://www.freelancer.com/projects/web-scraping/autologin-submit-billing-20761941/reviews
$100 USD in 2 days
4.9 (37 reviews)
5.5
5.5
User Avatar
I have read your project details and I can create your site search tool using scrappy. I have experience in all areas of web development. I am ready to start right away and complete promptly. I look forward to speaking with you more.
$75 USD in 5 days
5.0 (8 reviews)
5.3
5.3
User Avatar
Hi there, please leave a message on my chat so we can discuss the budget and deadline of the project. I have read your project description and i'm confident i can do this project for you perfectly. Thanks . .
$200 USD in 3 days
5.0 (10 reviews)
5.1
5.1
User Avatar
Hello, How are you? I'm very interested in your job post.I believe my skills would be ideal for your project. I am Python Expert and I have rich experience with Web Scraping(Google) and I can help you perfectly. And then I am a good english speaker. So anytime,anywhere you will discuss anything with me freely. My wonderful service will give you pleasure and happiness. I hope you will contact with me and work together. Best Regards..
$200 USD in 7 days
4.8 (25 reviews)
5.4
5.4
User Avatar
Greetings, Keyword search within articles. Yes, I understand what you want to achieve. The information returned can be the url link and/or a screenshot. Many different sites involved so that will not be an easy task. However, it is possible. I can provide you with the tool implemented on Python's Scrapy by uploading it on a github page with ample documentation to understand its use and/or internals. Contact me should you require assistance, MPA
$120 USD in 5 days
4.9 (19 reviews)
5.2
5.2
User Avatar
Hello, sir. how are you? I checked your all requirements and understood what you want. I have already similar experience with your Website scrapping & data processing & excel/database project before. I am an excellent C++/C#/PHP/JavaScript and Python programmer for web scrapping. And I can save scraping data into excel or google sheet or database. So I can complete this project easily as soon as possible. I can show my previous working history for trust about me. Please discuss with me more details in private messaging. Thanks.
$200 USD in 5 days
5.0 (4 reviews)
4.7
4.7
User Avatar
Good day! I'm a licensed full stack programming developer and designer. I have many experiences in python/Django and python selenium webscraping and python image processing by using python openCV package. I have many experiences in c#,c++,c,java programming. I had read your project description carefully. I'm interested in your project, please feel free to check my clients reviews, my profile and if you are interested too, we can discuss more details. Thank you very much.
$135 USD in 7 days
4.8 (21 reviews)
4.8
4.8
User Avatar
hello sir, i worked on several scraping projects, i also experienced with the famous scraping Python library Scrapy, and i am realy interested by this project and highly motivated to work on it, i will satisfy you, just contact me to discuss more details. good luck.
$135 USD in 7 days
4.8 (3 reviews)
2.8
2.8
User Avatar
Full Stack Developer Over 6+ years of diversified experience, I always try to give my best to each and every project. As a developer, I love to help my clients to complete their projects. From every project, I got a unique experience that helps me to achieve my next level. My area of expertise in Web Application Development Using some of the cutting edge technologies like: ✔ ASP ✔ .NET Core ✔ .NET Web API ✔ ASP.NET MVC ✔ ASP.NET Web Forms ✔ Python ✔ C# ✔ MS SQL Server ✔ MySQL ✔ HTML5 & CSS3 ✔ Bootstrap 4 ✔ JavaScript ✔ jQuery, UI jQuery ✔ Angular ✔ Web Services ✔ PHP & it's frameworks Why Me? ✅ Solution Oriented ✅ Excellent Communication & Understanding ✅ Honest & Friendly ✅ 100% Satisfaction Guarantee ✅ Competitive Rates ✅ Regular Project Updates ✅ On-Time Delivery ✅ Free Unlimited Revisions on the selected template (Before integration) ✅ Free Technical Support I am available at your flexible timings. Just ping me in private messages. I will reply back ASAP.
$70 USD in 7 days
5.0 (1 review)
0.8
0.8
User Avatar
Hello dear hiring manager With my good experience in core python, I can scrape any website with the help of Scrapy and Selenium. till now I have scraped more than 200 websites which includes Linkedin, Facebook, Twitter, Instagram, google reviews, Yellowpages, playstore, reditt, glassdoor and many more. I am a problem solver and I believe in providing complete solutions. If you have a project in mind and you don't even know where to start, then you've come to the right person. I'm flexible with my working hours and am happy to work closely with any existing freelancers you work with. You can expect prompt, polite and helpful communication from me. I believe communication is the key to any successful project, and I'd like to start things off on the right foot suggesting we schedule a phone or $kype call to discuss the project further. This will enable us to make sure we communicate well and that both parties are completely comfortable with the scope of the project. Please let me know a time that works best for you and I'll make sure that I make myself available. If you give me this opportunity, this would be my first project on Freelancer, so I'd be really regretful if you could give me this opportunity Kind regards, Himanshu
$250 USD in 4 days
0.0 (0 reviews)
2.2
2.2
User Avatar
What makes me the best candidate for this is that I can do this efficiently and fast, I won't waste your time and I'm very genuine/transparent with my clients.. You won't regret working with me, just give me a chance.
$70 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello! There is a lot of parsing experience. Ready to complete as soon as possible. I am writing in php, js. I will make a convenient admin panel.
$112 USD in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
New York, United States
4.8
89
Payment method verified
Member since Feb 8, 2005

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.