web scraping tool

  • Status: Closed
  • Prize: $20
  • Entries Received: 5

Contest Brief

Develop web scraping tool using python which is capable of doing the following tasks:

1. take input "District" and "Area in terms of sqft".
2. scrap the following website for example: https://www.srx.com.sg/
3. Return output to include
(a) images of the property
(b) agent's contact details: email or mobile number
(c) asking price
(d) property name
(e) district
(f) lease term



Reference
https://www.srx.com.sg/
https://www.mingproperty.sg/singapore-district-code/

Recommended Skills

Top entries from this contest

View More Entries

Public Clarification Board

  • arungautham
    arungautham
    • 6 years ago

    #increaseprize

    • 6 years ago
  • sunmoon11
    sunmoon11
    • 6 years ago

    https://www.freelancer.com/projects/php/website-scraping-mysql-website-design/

    • 6 years ago
  • sunmoon11
    sunmoon11
    • 6 years ago

    You can check my skill with this freelancer project

    • 6 years ago
  • sunmoon11
    sunmoon11
    • 6 years ago

    I can scrap any data with Python.

    • 6 years ago
  • helvdan
    helvdan
    • 6 years ago

    By the way I do not recommend to use a tool based on Scrapy:
    1. it is only a wrapper for crawling scripts and does not have smart data mining algorithm
    2. every time spider will be ran, Scrapy rereads the whole project which causes memory and CPU time loss
    3. its callback nature is uglifying python code making it unreadable. If you want asynchronous requests choose Tornado or greenlet
    4. it is over engineered

    • 6 years ago
  • helvdan
    helvdan
    • 6 years ago

    Hello.
    1. Do you need any GUI or you will run Python script via terminal?
    2. In what OS you intend to deploy this tool?
    3. Do you need to crawl another websites? If yes, can you give us some more example sites.

    • 6 years ago
  • k2lsuthar
    k2lsuthar
    • 6 years ago

    I have good hand experience in scraping website in python using Scrapy tool.And working on in from last two years

    • 6 years ago
  • apont7
    apont7
    • 6 years ago

    Good experience scraping complex websites using Scrapy, a Python Framework, in a Linux environment.

    • 6 years ago
  • apont7
    apont7
    • 6 years ago

    #increaseprize

    • 6 years ago

Show more comments

How to get started with contests

  • Post your contest

    Post Your Contest Quick and easy

  • Get tons of entries

    Get Tons of Entries From around the world

  • Award the best entry

    Award the best entry Download the files - Easy!

Post a Contest Now or Join us Today!