Find Jobs
Hire Freelancers

Create a Python script that standardizes scraped data from existing scripts before they're saved to a database

$30-250 USD

In Progress
Posted about 7 years ago

$30-250 USD

Paid on delivery
I have 10 different scraping scripts that I run through my VPS that each captures data from a website and stores that data to a database. There is a slight problem, as the data that is being captured is inconsistent, and I want to display the data in a consistent format in my database and website. You must create a Python script that will 'standardize' the data. FOR EXAMPLE: One of the fields that is captured on each website is 'Manufacturer'. Website 1: 'Manufacturer' = {GE, TOSH, WST} ---> {General Electric, Toshiba, Westinghouse} Website 2: 'Manufacturer' = {Westing., Toshiba, General elec.} ---> {Westinghouse, Toshiba, General Electric} I want to insert a script within each of the scraping scripts that accomplishes this. Some of the filters will require Regular Expressions, so your script should be set up to be able to handle that. ** I can fill out the specifics of the arrays myself, for which words should be substituted for the terms. I just need someone with Python knowledge to construct the script and the 'template arrays' and tell me where to place it within my scripts. ** I will provide you with a sample of one of the scripts. They run Scrapy, and they are all similar enough that you will probably be able to create just one script and it will work for all of my scrapers. The budget for this project is $50.
Project ID: 13768792

About the project

9 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
9 freelancers are bidding on average $116 USD for this job
User Avatar
Hi sir, This is kimi and I am scraping expert, I have did too many scraping projects, please check my profile page then you will know. https://www.freelancer.com/u/mantislin.html Can you tell me more details? then I will provide example data/script for you. Thanks, Kimi
$250 USD in 5 days
5.0 (425 reviews)
8.2
8.2
User Avatar
Hello, I have a lot of experience with web scraping and a lot of scripting experience in Python. I would love to help you with this. Please contact me for more information.
$50 USD in 1 day
5.0 (49 reviews)
5.0
5.0
User Avatar
hello I have read your requirement. I can help you to finish this work. Can you provide more information about this project? Thank you
$50 USD in 3 days
5.0 (20 reviews)
4.9
4.9
User Avatar
Hello Sir, How are you ? I read your description and I see that you have the array ready, if that's the case, then let's just start working on the project! please contact me, and thank you!
$55 USD in 3 days
4.3 (8 reviews)
4.6
4.6
User Avatar
A Python and web scrapping developer here ready to discuss this further and create this script (regex) to standardize this scraped data. Could you send me the sample script so I can understand better what you exactly want done?
$100 USD in 1 day
5.0 (9 reviews)
3.9
3.9
User Avatar
Hey i have a few questions and suggestions about the project, if we could talk in detail and make this work!
$77 USD in 1 day
3.9 (9 reviews)
4.3
4.3

About the client

Flag of UNITED STATES
Sheridan, United States
5.0
23
Payment method verified
Member since Jan 19, 2017

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.