Find Jobs
Hire Freelancers

Write some Software

$250-750 CAD

Completed
Posted almost 7 years ago

$250-750 CAD

Paid on delivery
Hello, I require a great Python developer to build a web scraping script using Python and Scrapy. The site is viewit.ca. The cities I need to work are Toronto, Calgary, Edmonton and Vancouver. Their URLs are: [login to view URL] (Toronto) [login to view URL] (Edmonton) [login to view URL] (Calgary) [login to view URL] (Vancouver) I need a Python script that does the following: - crawl through each of the links to the various suburbs on the above page - for each suburb, run a separate search for each bedroom criteria (e.g. 1 bedroom, 2 bedroom etc.) - for each search result, see if you have scraped it before, if not, then go to the listing details page and scrape all the details of the listing including images - use the criteria that was entered in the previous search page (bedrooms and furnishings) to supply the number of bedrooms and furnished status for the ad - saves all listing details to MySQL by calling a stored procedure - all DB work will be done for you, you just need to call stored procedures - the script must take a parameter that tells it to scrape images or not - the script must be able to save images to AWS S3 using boto or some other way - the script should pass save the URLs of the images on S3 to the db by passing them as parameters to the stored procedure - the script should use Scrapy 0.22 or later and run on OS X or AWS Linux - the script should be run under Python 2.7.9 or earlier, not Python 3 Elements that I need scraped from the listing details page are: - URL - Title of ad - price - bedrooms (determined by search criteria) - furnished or unfurnished - Pets allowed or not - address (can be taken from link to google map on page) - description - phone number - all images Thank you for your bids.
Project ID: 14263272

About the project

27 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
$355 CAD in 10 days
5.0 (7 reviews)
4.3
4.3
27 freelancers are bidding on average $490 CAD for this job
User Avatar
Hello Sir, We've done a number of web scraping projects for our clients. We have scraped many directory websites including yellowpages, yelp and e-commerce websites including amazon, walmart etc and many more. We can deliver the data very quickly. We use proxies with IP rotation to avoid being detected as bots. We use python with wget, phantomjs, casperjs, slimerjs, scrapy, urllib and other tools to fetch webpages and parsers like HtmlXPathSelector, regular expressions etc to extract information from the html. We have the right skill set to do this job effectively and within time and would like to discuss more about this opportunity. Looking forward to hear from you. Thanks, Rajdeep Agrawal
$333 CAD in 10 days
4.9 (80 reviews)
7.1
7.1
User Avatar
Dear Sir! I really like your proposal. Do you have other problems? I plan to use python 3.6 . Being I am an expert of scraping, I promise help you perfectly. Now I am ready to work with you. Best regards.
$250 CAD in 3 days
5.0 (23 reviews)
6.7
6.7
User Avatar
Hi there! I have read what you exactly need, however I would like to ask you a few questions. I wouldn't call myself a master but I do work smart and do not rest until I get the job done. Please feel free to ping me anytime so we can have a detailed discussion. If I can deliver I will deliver in best possible way. Thanks
$555 CAD in 10 days
5.0 (18 reviews)
6.7
6.7
User Avatar
Hello sir. I 've read your post and so very interested in your job. I 'm sure I can satisfy you with my ability. I 'm working in part of coding and software developing for over 6 years. I have much experiences in developing software and programming. I major in , Web scrapping,web scrapy, Python(Django), HTML5, Javascript and Jqeury. I can offer you my projects before. Then you can trust me and check mine. Please let us contact and make a good friendship. Thanks.
$555 CAD in 10 days
4.8 (98 reviews)
7.0
7.0
User Avatar
Hi there, I have checked the website you mentioned. I can write python program/script to extract data from this website. I have good web scraping reviews for my past projects..Hope to hear from you..
$250 CAD in 2 days
5.0 (170 reviews)
6.5
6.5
User Avatar
Hi, I (Myself a senior PHP Developer) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bug-free codes at the very first instance. After seeing our quality of work and the cooperation offered to you even after the work has been delivered to you, you’ll come to us again and again to avail our services. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I can achieve the results that you are asking for within your timeframe and budget. I am confident I can exceed your expectations and I would love to work on your project. Warm Regards ~Team Shopify
$721 CAD in 15 days
5.0 (9 reviews)
5.8
5.8
User Avatar
Hi I am really interested in your project I have full experience of web scraping by using python I could satisfy you Everything will be done well if you work with me Thank you
$555 CAD in 10 days
4.7 (21 reviews)
5.8
5.8
User Avatar
Dear sir. I am expert java ,python, php and ruby developer. I am keen interested in this, but I want to know your more detail requirements. I am looking forward to hearing from you. Thanks.
$777 CAD in 10 days
4.9 (4 reviews)
4.5
4.5
User Avatar
Hey this is kartikeya with 3+ years of experience in data scrapping/python/selenium for extracting data. I have previously scrapped linkedIn, amazon and snapdeal.I use scrapy to scrappe data in bulk and can also provide script. I am confident about this job also. I have sources for emails and leads too. Ping me to discuss details and start the work
$555 CAD in 10 days
5.0 (19 reviews)
4.5
4.5
User Avatar
Hello, My name is shahid from Kashmir Over the last 7 years, I have worked for several clients. Joined Freelancer with over 7 years rich experience in the field of data mining data scrapping, I am certified python developer, I have successfully completed more than 1000 projects in this field you will be glad to know that I am best fit for your project my key skills are Dataentry,Excel PDF Data mining data processing web scrapping LinkedIn Leads python and much more I am a highly skilled web researcher,web scraping,data mining, LinkedIn,leads,Python data entry etc. Provider seeking an opportunity to leverage my expertise and demonstrate my high level of technical an administrative skills. I have successfully completed more than 100 projects ranging from, oodo ,Data mining ,data processing ,web scrapping,LinkedIn ,Leads,python and much more. I am waiting for your response regards shahid.
$250 CAD in 5 days
5.0 (6 reviews)
4.5
4.5
User Avatar
We at IEOTA TECHNOLOGIES have lot of exposure and experience in development for past 4 years served for several clients across the globe. We have fabulous developers who have extreme knowledge in coding and vast experience in various technologies such as HTML 5 ,CSS3, BOOTSTRAP, BOILERPLATE, JAVA SCRIPT, J QUERY, Ajax, PHP, MYSQL, LARAVEL, CAKE PHP, Codeigniter, WORDPRESS, Drupal, Joomla, Custom CMS, Magento, OpenCart, Prestashop, Woo Commerce, Virtue Mart, Shopify AND .NET TECHNOLOGIES. We at IEOTA TECHNOLOGIES have a team of 30+ people make ourselves to be in your socks, we envision your ideas and give it life, irrespective of size or complexity 5 Reasons why you should hire Us for your Work: 1. Available 24/7 upon your request 2. Delivery on-time with 100% satisfaction 3. Always think beyond boundaries and provide user friendly solution 4. Provide excellence with commitment 5. Most important, Free technical support for lifetime.
$555 CAD in 10 days
4.6 (10 reviews)
4.4
4.4
User Avatar
Hi there! I have read what you exactly need, however I would like to ask you a few questions. I wouldn't call myself a master but I do work smart and do not rest until I get the job done. Please feel free to ping me anytime so we can have a detailed discussion. If I can deliver I will deliver in best possible way. Thanks
$555 CAD in 10 days
5.0 (1 review)
3.8
3.8
User Avatar
Hey, I am a professional in extracting data from a web page. I work with some useful tools which is why I can get data from web page fast and accurately. My skills and services include: - Web scraping - Data entry - Data mining - Data processing - Excel - Oracle - etc. Hope my skill and work can help you with your business. Thanks.
$250 CAD in 5 days
4.7 (9 reviews)
4.2
4.2
User Avatar
Hi, Greeting for the Day!!! I have analyzed your job requirements for a Python developer. I worked directly with the clients to deliver an accurate and workable specification, so projects can completed on time, on budget. I am also experienced with Adobe dream weaver, Flash, front end development, HTML5/CSS3, Javascript, Ajax, Jquery etc. >I pay attention to detail and discover alternative ways to do the task and choose the best one to do it. I am a fast learner and usually able to acquaint myself with new things. I will be available online on Skype and by phone to support you. I will do whatever it takes to make sure you are satisfied with work as Client Satisfaction is my aim. Thanks
$555 CAD in 10 days
0.0 (0 reviews)
3.0
3.0
User Avatar
Hello,   Over the last 7 years, I have worked for several clients. Joined Freelancer with over 7 years of experience in , Data entry, Linkedin Lead generation , Google Research Expert,Web scraping.  Python and Scrapping expert with 5 years of experience.  Linkedin API developer.  Using Python, Wordpress , C Programming ,  C++ Programming, Linux,PHP,MYSQL ,Java ,Javascript ,Website Design ,Graphic Design,CSS,Research,Wordpress ,Magento ,Leads ,Web Search ,Machine Learning ,HTML5 ,Linkedin ,Landing Pages ,Web Services ,Internet Research ,Angular.js ,,Data mining,,Web scrapping,Find contacts, Data Processing,  I am a highly skilled web researcher,data entry provider seeking an opportunity to leverage my expertise and demonstrate my high level of technical an administrative skills.  I have successfully completed more than 100 projects ranging from web research, data entry, Internet Research, Linkedin Lead Generation, Google docs & Excel Spreadsheet creation/editing.  Regards:Nabeel
$250 CAD in 4 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I've actually built (exactly) these types of scrapers in the past, also using Python, to scrape real-estate objects and attribute them.
$550 CAD in 8 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of CANADA
Calgary, Canada
5.0
13
Payment method verified
Member since Nov 25, 2013

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.