Closed

Scraper for multiple e-commerce websites

We're looking for someone who can build a scraper that will scrape the products/clothing items from several e-commerce websites to create a single database. We'd like these products displayed on a website where visitors can browse and filters the items based on sizes, colors, types of clothing, and more. The visitor does not need the ability to purchase from our website; instead, we will offer an affiliate link to the 3rd party website where the visitor can buy it.

Our website will only focus on 1 style of clothing (petite) so we will provide the direct URLs to this category for each ecommerce website. The initial sites will be:

-[login to view URL]

-[login to view URL]

-[login to view URL]

-[login to view URL]

-[login to view URL]

*Alternatively, if any of the sites provide an API, you can use it instead.

We will start by scraping these 5 e-commerce sites. The chosen developer will be paid to add additional websites at a later time.

*Phase 1:*

Build the scraper. Perhaps something like [login to view URL]

1. Scrape all data provided by the e-commerce website; some examples of required data (if provided):

*Product name

*Photos

*URL to product

*Price

*Sale price

*In-stock/out of stock

*Size

*Brand

*Category (shirt, pants, shorts etc.)

*Color

2. Configure the scraper to be executed daily.

3. When the details of a product changes (such as the price or "in stock" status), update our database accordingly.

3. "Flag" any items in our database that are no longer available (i.e., item does not exist on the website anymore but still exists in our database)

*Phase 2:*

Create an admin panel that displays all products scraped.

1. Allow admins to add any missing data for the product.

2. Allow admins to assign custom keywords/tags to each item (pattern, solid, striped).

3. Create a button that allows us to "Add Product to Website", which allows the product to be visible on the website (alternatively, they should be able to toggle to "Remove from Website").

4. Allow #2 to be completed in mass (check boxes that we can add/remove multiple products at once).

5. Add an option for each product to "delete". Deleting will remove the product from the admin list/prevent it from showing again in the future.

6. Basic filtering in the admin to sort the products.

7. A filter/page that lists all items that no longer exist (see Phase 1, #3).

8. A section to manage "affiliate links" for each e-commerce website.

For example, when we display a product link to "[login to view URL]", we need to automatically append parameters to the [login to view URL] URL, ex:

[login to view URL]

will become:

[login to view URL]

*We need this page in the admin to allow us to define the parameters that must be added to each 3rd party ecommerce domain we're going to link to

*Phase 3:*

Create a public facing website with a basic fashion e-commerce theme

1. We'll need your help choosing a CMS that will be the best fitting for this type of website (Wordpress with WooCommerce?)

2. The website will need to contain filtering options for filtering the products. For example:

[login to view URL]

Filtering options include:

*Price range

*Size

*Brand

*Category (shirt, pants, shorts etc.)

*Color

3. An option to "Sort results by".

*Most popular

*Price high to low

*Price low to high

*Newest

Example:

[login to view URL]

4. Display 12 products by default, load more products as the user scrolls down

5. Each product will need its own "view product" page that provides all the information we have stored as well as a link to the 3rd party e-commerce website to purchase the item

6. A global search box/search results page

7. Track number of clicks on the "purchase item" button for each product. We will need this to track the "most popular" items (needed for #3)

Skills: MySQL, PHP, Python, Web Scraping, WordPress

See more: e commerce websites, e-commerce websites, website development and design and e commerce websites, e commerce websites in uae, all india e commerce websites name and email, amazon international e commerce websites, art e commerce websites, buy e commerce websites, c2b e commerce websites list, cheap e commerce websites in dubai, china e commerce websites, drupal e-commerce websites, e commerce websites alibaba, e commerce websites description, e commerce websites developer noida, e commerce websites developers in india, e commerce websites developers in kolkata, e commerce websites development, e commerce websites development application, e commerce websites development india

About the Employer:
( 0 reviews ) United States

Project ID: #17576692

57 freelancers are bidding on average $576 for this job

sapotacorp

Dear AlessandraJones1. I have experienced with woocommerce. I check [login to view URL], [login to view URL], [login to view URL] More

$574 USD in 16 days
(966 Reviews)
8.6
OutsourceMan

Hello, This is Vaishali from "Hire WordPress Experts" and I am here to help you with Scraper for multiple e-commerce websites . We have gone through the information provided by you. and I can assure you that we are More

$250 USD in 5 days
(328 Reviews)
8.0
SigmaVisual

Hi, I have extensive experience of working on similar scraping projects, I can help to develop a crawler to scrape products data from the websites you mentioned and create a single database. Please let me know when you More

$250 USD in 10 days
(289 Reviews)
8.2
mhmhz

Hi I can work only on the 1st phase (scraping) I bid with 90 USD per site. I will provide scrapers that can run in "windows VPS" and export to the database. later your site can connect to this database. More

$450 USD in 2 days
(154 Reviews)
7.6
Vlzinch

Hi,Alessandra! I’m experienced Python developer, and web-scraping is one of my main fields of knowledge, so I’m 100% confident that I can scrap websites you need and organize the product database. Please contact me More

$500 USD in 5 days
(63 Reviews)
7.5
maysaxena

Greetings! We are a team of experienced professionals and would like to complete your work with quality work. Have a look at our profile and our reviews. We are capable of setting up a website with sleek and sizz More

$750 USD in 10 days
(357 Reviews)
7.7
mmadi

Dear AlessandraJones1 I have gone through your project Scraper for multiple e-commerce websites Can we do quick chat right now so that we can discuss the project briefly? I do have similar experience doing somethi More

$525 USD in 12 days
(44 Reviews)
7.0
mirniyazuddin92

Dear Sir/Ma'am, I can scrape for multiple e-commerce websites. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir

$750 USD in 10 days
(157 Reviews)
7.1
uumarkhalid31

Hi I am expert in web scraping and data mining and i have done several scraping jobs similar to this one. Please check my profile as thats the best thing i can present you as a proof of my skills. After checking pleas More

$500 USD in 4 days
(219 Reviews)
6.9
bestit4u

Hi. I am very interested in your project, because I have much experience in such projects. I have good skills with the program language including C/C++, C#, java, php, asp.net, python, VB.NET. So I have expert and s More

$555 USD in 10 days
(97 Reviews)
6.9
uumairkhalid

Hi there, I can scrape these websites as I have more than 7 years of experience in this field. I have checked the website and i assure you that i can scrape them for the details you want. Looking forward to hearing ba More

$555 USD in 3 days
(150 Reviews)
6.9
zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within More

$555 USD in 5 days
(58 Reviews)
6.5
AzzkaNoor

I have read your project details. I have to ask a few questions. Can you please message me via chat so we can discuss all the details to elicit all the requirements and hence start the development? I will showcase al More

$555 USD in 10 days
(19 Reviews)
6.4
sauravkumar120

Hi there, I would like to let you know that I have successfully built more than 150 multiple website based on WordPress for our clients. I have ample experience in not only WordPress but in Magento,Shopify,Wix,Square More

$411 USD in 8 days
(136 Reviews)
6.6
devi222

Hi Sir, I’m a Python Programmer. I have created many Bots to scrape the websites like Amazon(UK, USA, AU, de),Alibaba(suppliers data), Linkedin, Facebook, Trulia(real estate, homes), [login to view URL], Amazon(using API), A More

$360 USD in 4 days
(109 Reviews)
6.4
schoudhary1553

Hello, Hope you are doing well. I can help with you in your project Scraper for multiple e-commerce websites. I can assure you the quality job. I have good experience in MySQL, PHP, Python, Web Scraping, WordP More

$750 USD in 12 days
(54 Reviews)
6.3
ykarora26

Hello Sir, As a self-motivated, solutions-oriented and passionate individual, I have been actively involved in implementing WordPress security and have considerable knowledge of PHP and MySQL Injection. With over 8 More

$666 USD in 10 days
(127 Reviews)
6.4
sunmoon25

Hi I have done many difficult web scraping and ecommerce product scraping projects. I will provide you all accurate data from the sites. I can start the work today. Please contact with me for discussion. Thank you.

$680 USD in 12 days
(62 Reviews)
6.2
webmantratech

Greetings from WebMantra! As nutshell you can take us as your long term IT partner. I assure that, our development cost will come along with many values added services. I assure low cost, faster delivery and quality pr More

$555 USD in 10 days
(40 Reviews)
6.4
androidc

Hi there, My queries:- 1. Which payment gateway you want to integrate? 2. Do you also want to add any shipping charges? Please clear me these points. I am ready to start working today. I've 7 year experienc More

$555 USD in 10 days
(94 Reviews)
6.4