Scrape data sources, load to a DB, create a dashboard in a portal- Website creation

$15-25 USD / hour

Cancelled

Posted

over 4 years ago

$15-25 USD / hour

NDA required You are bidding on Phase 1 only but understand phase 2 and 3 and confirm you can do it. Develop software that can scrape and/or query data from provided third-party websites, and create a database or storage system to host the data. Open to suggestions, Once the database system is created, create a front-end or leverage an open-source project to display data in a meaningful manner. You should assume the websites will be provided and they are open for data extraction. Scrape/Query data from third-party websites for an integration into a single storage . Ideally a scalable model to support massive data amounts. Phase 2 Develop software that can ingest databases we feed it, normalize it, and quickly load and index it within a database. Make it scalable and fast. Phase 3 Portal with open API so anyone can connect to the data Phase 4 Create a full website with client accounts and each client account has their data

Software Architecture

Data Mining

Data Science

Data Scraping

Project ID: 22734055

About the project

11 proposals

Remote project

Active 4 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

11 freelancers are bidding on average $22 USD/hour for this job

@dreamci

Nice to meet you We are top quality full-stack developers and we are ready to work on this project, we use Version Control Systems, Staging Servers, Team Slack Channel and Task Management Tool Contact me for an enjoyable and reliable development experience. Thanks!

$40 USD in 40 days

5.0

(91 reviews)

8.5

@luiswilliam

Hi, Chris M.! I read the description of your project thoroughly. I understand your requirements initially and I have experiences of the field. I am a specialist of: * React.js, Angular and Vue.js for Front-end, * .NET Core API for Back-end side, And these are also my talented fields: - Web scrapping - Desktop Utility Development using C#, Java or C (Windows and other OS) - Wordpress blog, and other eCommerce website building such Shopify, Prestrashop and Squarespace For all of above, I can provide proofs of my past works. However, you can see my work reviews in profile page and confirm my work quality. Now, I have enough time to work for your project and I'm ready to go with you. Usually, I would provide a long term support about the work I delivered. Looking forward your contacting. Thanks! 1575685926790

$20 USD in 2 days

5.0

(17 reviews)

5.9

@imteyazkhan85

Hi, I found your job posting and I think I’d be a great fit. I am an experienced in data scraping field. . As per your requirement, I would like to tell you that we have a very strong experience of more than 5 years in this field.

$20 USD in 40 days

5.0

(7 reviews)

4.2

@coolmob0816

Hello. How do you do? As I am a senior web developer , I have read your description and have interesting to your project. I have rich experience in web scraping field , I have developed the python scraping app , Node scraping app. For this project, I can use both scraping apps and can develop the backend using Django and Express js. I can use the MySQL or MongoDB as the database. After developing the backend, I can use the React to develop the Frontend. In the Phase 2, I can use the Python or Node js to develop your software. I can improve my web app to the phase 2 and 3, 4 and I hope to work with you for a long time. Please contact me, I can work full time for you and will provide you with the satisfied result every phase. I look forward to your response. Best regards

$15 USD in 40 days

4.9

(8 reviews)

4.3

@jasminseo6

Hi Dear client, Data Entry & web scraping expert team here and we will start your work right now and will show you sample work on some entries and will work with your 100% satisfaction. We will scrape all info like, name, phone, address, email, website and more if required. 12.5 year experience - Data Entry, Web Scraping, Excel, SEO, Linking building, Google promotion, social media marketing, Graphic Design Regards- Jasmin Regards- Jasmin

$15 USD in 40 days

4.9

(9 reviews)

4.0

@arjun366333

Hello, we are interested in your project. Please send me a message so that we can discuss more. I prefer to submit my detailed proposal after our discussion. Note: + We are flexible with changes. + We also provide post-implementation application support &maintenance Thanks, regards Kanta Singh.

$20 USD in 40 days

4.1

(15 reviews)

4.6

@dineshreddykdp

Hello I have just reviewed your job description carefully. I have 5+ years of experience in web scrapping and web development with Python, C#, Php, Javascript, … You can check my scrapping reviews. I can start right now and will finish this project asap. Looking forward to hearing from you. Thanks in advance for your time and consideration. Best Regards

$20 USD in 40 days

5.0

(6 reviews)

3.0

@thinkbased

Hi , I did many similar scraping project already with high load. The system will be designed with a powerful queue system and fantastic GUI dashboard to avoid any data lost during scraping and you can see report of each portion of process graphically . Let's talk in details if you are interested.

$20 USD in 40 days

4.8

(1 review)

2.6

@sarow471

Hello I am Sandeep and I checked your job Description, I do understand that you looking for an expert web developer My relevant experience and background, comes from the over 100+ websites that I have developed in PHP , from concept to completion. And I checked you need a project in 3 steps so I will do the work according to you and I need more infomation to understand your job and I will happy to sign NDA Thanks

$20 USD in 40 days