Data Scraping
$100-500 USD
Paid on delivery
I need [[login to view URL]][1] scraped and the data extracted to a database or Excel format.? Website does not require login.? They give permission for data copying (h[ttp://[login to view URL]][2])
DATA DESCRIPTION
There are 8 main categories: Makeup, Skin Care, Hair Care, EyeCare, Nail Care, Baby Care, Oral Care, Fragrance.? Each category has several Product type sub-categories.? Each subcategory has several products.
The format is constant.? The scraping should pull data from each product page as follows:
Category Name, Product Type, Product Name, Animal testing (yes, no, unknown), & Ingredients.
In addition, each ingredient is linked to a description page. (For example:
[[login to view URL]][3])
The Ingredient data to be scraped (on the right side of the page at the top):
SCORE: the hazard level and data gap
ALSO LISTED AS: all text
For the Ingredient data, I am only looking for a master list of ingredient description.? That is, if Saccharine pops up in multiple products, I need the data on Saccharine only once.
There are 40,000+ products.? I do not know how many ingredients there are.
THE JOB
Scrape the text? and dump into a database.? I will also need the software so that I can refresh the scrape from time to time
Project ID: #3800320