Spark job to convert a csv to parquet with desire column name and data format

₹600-1500 INR

Completed

Posted

almost 4 years ago

₹600-1500 INR

Paid on delivery

I want you to build a spark job, which can convert a csv file to parquet file. CSV file column name should be converted to the desire format in the parquet file. Also you need to add new column to parquet file, which will have data from another column.

Spark

Scala

Python

Project ID: 26705234

About the project

3 proposals

Remote project

Active 4 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@Prasanthmrc

I have done similar requirement this week. I have 5+ years of industry experience in python and Big data technologies. I have code handy. I can deliver as per the requirements.

₹1,800 INR in 1 day

0.0

(1 review)

0.0

3 freelancers are bidding on average ₹2,319 INR for this job

@MicheleVlfr

Hello, I think to develop a python application with a GUI(I think to use Qt5) which allows to select a csv file from your computer, parse it(maybe using a parser generator as lark) and translate it into Parquet. Please, could you provide more details about it(maybe some example files)? Let me know

₹4,357 INR in 2 days