Find Jobs
Hire Freelancers

Extract companies, phone numbers, locations from >100gb of data.

$250-750 USD

Closed
Posted about 4 years ago

$250-750 USD

Paid on delivery
Looking for someone to extract entities from WARC files as well as download additional files linked from them. There may be as much as 1tb of data here, so it must be scalable. We have a detailed spec.
Project ID: 24760156

About the project

24 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
24 freelancers are bidding on average $444 USD for this job
User Avatar
Have over 10 years of experience in data mining/ Web scrapping/ Scraping Bots/ Chrome/Opera Extensions I have done it all. Tell us your source and we will put it in excel for you, Or we can even give you filtered results as per your requirement, In the format you want. You can also ask for data into a particular format - Excel, Json, Mysql, Databases, XMLs, you name them. Further Can help you with integrating it with ur databases, Can create json outputs. We are not only good with scraping but also with the tools that u may need after that. We can help you build you softwares round the data we have 99% Data Accuracy. We have Duplicate finder. etc., We can help with Statistics on the data We can help with creating Api's front the data We can create Softwares to manage that data We can build Sites round the data
$833 USD in 2 days
5.0 (12 reviews)
6.2
6.2
User Avatar
I can do it
$500 USD in 7 days
5.0 (17 reviews)
4.9
4.9
User Avatar
Dear Contact Person, I have vast experience in web search, web research, collecting information, data entry and excel formatting. Please send me a message for more details.
$250 USD in 15 days
5.0 (11 reviews)
4.5
4.5
User Avatar
Hello, I'm Ankit I'm interesting your project very well I'm good in Website Design, HTHML, CSS , JAVASCRIT, JQUERY, AJAX, PHP and mysql expert. I’m quite well experienced in these jobs. Let's go ahead with me I want to service for you continuously. Thanks Looking forward to discuss with you. Regards
$600 USD in 7 days
5.0 (3 reviews)
3.2
3.2
User Avatar
We are the one-stop provider for all your Scraping, Data Extraction, and Web Automation needs. Get a complete end-to-end solution on time and budget with full integration support.
$500 USD in 7 days
4.0 (2 reviews)
2.6
2.6
User Avatar
HIRE US ONCE YOU WILL BE SATISFIED FOREVER Hi there! I came across your post and found that my expertise is the best fit for this job. So, I’d like to work with you to produce the best result. Please check my profile for have an idea about our past work Please invite me via chat so that we can discuss the details of the project and provide you an exact quote with a timeline. Thanks & Regards JK
$699 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Sir i have a team of profetional scrapers so we will provide you work with perfection and acuracy so kindly look into the offer and hire us and recomend us for best results
$333 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I am extremly comfortable working in Python and R. If required I can make the project to production phase as well. Since this project requires cloud infrastructure. I can build a highly scalable data extraction module in the cloud. Not concerned much about the payment. Once the project ends I can also provide free support for desired amount of time. Hope to have a conversation with you for discussing the details of the project Thanks
$250 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hey I'm am sahabaz Gazi I am interested in your project I assure you to complete the project within time limite give me a opportunity to provide my service to you Thank you
$556 USD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
HI MY NAME IS SHITAL DHAWALE AND I AM FROM MAHARASTRA INDIA I AM GRADUATE B COM I AM A COMPUTER OPRETER
$500 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I understand your proposal and having well knowledge in web research and also data entry. Having well experienced in data scraping. I'll complete the task on time with 100% accuracy. Looking for a positive response. Thanks with regards Sathiya N
$250 USD in 2 days
0.0 (1 review)
0.0
0.0
User Avatar
Bid Proposal I am a highly-skilled support professional offering office skills like web researching, data entry, data mining and other administrative skills. Keen on using Microsoft programs and Google drive/docs. With almost eight years of the successful track as a data entry specialist and as a top-rated freelancer, I am confident that I will make an immediate contribution to your team. I am a strong planner and a problem solver who readily adapt to change works independently and exceeds expectations. Able to juggle multiple priorities and meet tight deadlines without compromising quality.
$278 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi Professional data scrapping team is here to assist you in getting 1TB volume. Warm Regards ...................
$750 USD in 7 days
5.0 (1 review)
0.0
0.0
User Avatar
Welcome! I have an expert developers with skills including Regular Expressions, Data Scraping, Web Scraping, Scripting and Data Extraction. Please get in touch with me to discuss more about this project. We are awarded with PREFERRED FREELANCER BADGE by Freelancer.com We have more than 127+ Client reviews (feedbacks). Please check our profile and portfolio here: http://www.freelancer.com/u/Hariomtechnology.html. Thanks a ton!!
$630 USD in 25 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi there, I’m a Cloud Architect by profession and have several years of experience in ETL operations. Would be happy to help you. Looking forward to your reply. Thanks Pranay Relevant Skills and Experience Apache Spark, Python, ETL, databricks, SQL
$311 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I am here to help you in your business and Professional work in top quality outcomes concerning work any kind of Data Entry Job, Retyping, Image to Text, Hand writing to Text, Research Projects, Copy Paste Jobs and Typing Etc. I am a Data Entry and typist Professional and virtual assistant. I have good knowledge of MS-Word, Excel, PowerPoint, Photoshop. I have Good communication skills, Responsible, Dedicated and willing to learn new things. I pay great attention to details. I highly respect deadlines and I am completely dedicated to my Job. I always put the best efforts and produce the best results. I am specialized in: * Data Entry. * MS-Word. * Excel. * PowerPoint. * Typing. * Image to Text. * PDF to Word/Excel and vice versa. * Photoshop. And other computer and internet skill as well. Please contact me you will find quality work and satisfaction. Thank you!
$250 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, my thought to solve this by using scripting language Python and use it’s built in library or warc files which allows to extract warc record. Also, regular expression in the script to match the pattern of additional links and eventually download warc files. Since the size of files is in TB then I will prefer to multiple process for task so to achieve a good performance and scalable solution.
$300 USD in 15 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Respected, I am very excited to do this project and I assure you that the work will be accurate and to the point in minimum time.
$250 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
I am confident that I will collect as much as information about the companies in given time.i am very precise at web scraping and I have experience Relevant Skills and Experience Fast writing .many years of experience
$444 USD in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Los Angeles, United States
0.0
0
Member since Apr 6, 2020

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.