Python data scraping with scrapy
$30-250 USD
Paid on delivery
I have multiple user profiles need to check regularly and scrape the new content if there is something new (like scanning profile and get all articles from that user).
Usernames can be submit from a form (multiple lines) and save it to database too.
I want it was written in Python as Django app, scraping module using Scrapy. I have done some research and find the Django Dynamic Scraper plugin, fit my need ([login to view URL] ). It will run on schedule (like every 12 hours) and scrape the content, save that content to database for me.
I need someone who can help me to do the above job. Install, config and run (follow the example and adapt it to my case).
Further work might need after it was config and run regularly.
Need people who have time and can start immediately.
Project ID: #11368391
About the project
Awarded to:
Python professional, good at web framework such as django/flask, rich experience in web scraping with Python, had crawled many sites such as Amazon, Twitter, iTunes app store, etc.
6 freelancers are bidding on average $155 for this job
Hi I have gone through the details of your project and we find it well within our capabilities. I offer a wide range of services, including Web design, PHP/MySQL web application development, Open sources like J More
We are team of excellent developers. We have 2 year experience related to your project field. We can do your project and solve your all problems according to your requirements. We have read your description for project More
Hi there, I am a professional django web developer, having developed many websites and application using django, I have used scrapy for many times. Ping me for discussion.
