Filter

My recent searches
Filter by:
Budget
to
to
to
Type
Skills
Languages
    Job State
    5,012 spark jobs found, pricing in AUD
    Data Engineer 6 days left

    Converting SQL scripts into Spark-Scala Framework.

    $698 (Avg Bid)
    $698 Avg Bid
    13 bids

    Problem Statement: Design scalable pipeline using spark to read customer review from s3 bucket and store it into HDFS. Schedule your pipeline to run iteratively after each hour. Create a folder in the s3 bucket where customer reviews in json format can be uploaded. The Scheduled big data pipeline will be triggered manually or automatically to read data from The S3 bucket and dump it into HDFS. Use Spark Machine learning to perform sentiment analysis using customer review stores in HDFS. Data: You can use any customer review data from online sources such as UCI

    $19 (Avg Bid)
    $19 Avg Bid
    3 bids
    Java Developer with Kafta 4 days left
    VERIFIED

    Java Developer with Kafta , Cassandra and Spark JD) Experience - 3+ Skill - Apache Kafka,Cassandra,Core Java,Kafka,Spark,Apache Spark Need hands on java developer with good knowledge of Kafta , Cassandra and Spark

    $2323 (Avg Bid)
    $2323 Avg Bid
    12 bids
    Book Promotion 4 days left
    VERIFIED

    I would like to have this book promoted to potential readers. Christian Religion Political Social Message suitable for all audiences any persuasion Seeing Beyond 2020 Vision 2 x 11 is 22 new edition release in 2022 previous title was Seeing Beyond 2020 Vision Available on Amazon, Barnes and Noble and many more through Ingram Spark Distribution worldwide. Can use the following blurb Do you want more riddles rhymes and reasons? Well you've got it multipiled! 2 x 11 is 22 times more than you can think of!!! That is my new release of Seeing Beyond 2020 Vision 2 x 11 is 22 which is the 2022 Edition. 2022 came along and things got multiplied all over the world! So you got an updated cover and 2 more chapters, formatting improved inside, what more can you ask for? 2 x 11 is 22...

    $119 (Avg Bid)
    $119 Avg Bid
    5 bids

    Everything Abundant Recordings is a Recording label Something that will spark curiosity

    $14 (Avg Bid)
    Guaranteed
    $14
    40 entries

    Hello I am building a real time streaming analytics system, that will be used to analyse and trade the stock markets. I am looking for a Kafka expert who can pipeline the data from the broker, and then set up machine learning in Spark ML for me. You will be paid hourly for your time. You will get on call with me and advise me while I work hands on. If you know deployment of the models then that is plus points.

    $25 / hr (Avg Bid)
    $25 / hr Avg Bid
    6 bids

    ...to Ozzie UI to see the logs Subject : Job Opportunity With VakIT Systems | Remote Dear Candidate, Greeting from VakIT Systems. I found your candidature suitable for the below opening with our esteemed client. Hiring for "Spark developer role with US IT based Required Experience: 4+ years atleast two years of spark experience Salary : 40 lacs. Required Qualification: B.E/ Location- Hyderbad | Remote till covid end Timmings : 6:30PM-2:00AM IST Job Description: 1) 4-5 years of Hands-on experience on components of Hadoop Ecosystem like HDFS, Hive, Spark, Sqoop, Map Reduce and YARN 2) Handson Experience with data integration projects on AWS and database platforms (RedShift, Athena, Aurora). 3) Experience In AWS service like S3,IAM,EMR,EC2,AWS Glue, EMR...

    $17 / hr (Avg Bid)
    $17 / hr Avg Bid
    6 bids

    I would like to Instagram AR/VR 3D Animated Filter for a Restaurant. The theme is the amazon rainforest. The scene would be pointing the phone out to the plate and the filter would show growing a tropical forest around the plate on AR. Skills on Spark AR software are ideal

    $33 / hr (Avg Bid)
    $33 / hr Avg Bid
    18 bids

    converting the PL/SQL procedure code into Pyspark code (Python/Spark) . Two procedures are PL/SQL

    $80 (Avg Bid)
    $80 Avg Bid
    19 bids

    ...be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We also consider qualified applicants regardless of experience in any technology if you demonstrate the spark in you to learn, adapt and produce results. ...

    $17 / hr (Avg Bid)
    $17 / hr Avg Bid
    1 bids

    I have a Youtube channel with monthly short (4 min) videos on Global issues created with Adobe Express (formerly Adobe Spark) using background music. I need to convert these to 45 minute Powerpoint presentations with a narrated soundtrack - that would extend the video to say 45 minutes. My 4 minute Spark videos will not change for some time - I don’t need help on them, it is the conversion process from Spark (Express) to Powerpoint I need assistance on and in particular using narration not background music . My videos are mostly colourful images superimposed by large text displayed for between 5 and 12 seconds against the background of continuous dramatic music. I am an experienced narrator and presenter, no problem there but how do I plan it all out ? I...

    $55 / hr (Avg Bid)
    $55 / hr Avg Bid
    19 bids

    Spark Streaming development. Data ingestion from kafka, data processing in spark and sending data to kafka topic. Do it in google colab.

    $87 (Avg Bid)
    $87 Avg Bid
    1 bids

    Build a spark structured streaming using colab python.

    $122 (Avg Bid)
    $122 Avg Bid
    15 bids

    Streetwear Clothing Brand Tagged May 01, 2022 Overview Owning a Tagged product signi...suitable for the industry we reside in. The logo needs to be attractive to teenagers of the upper class. We’d like something slick, modern and trendy. Since our pieces of clothing will be of different colours, we would prefer if the logo has a good colour palette that could match with most colours used in clothing (Blacks - Whites - Blues…etc.) We will have multiple drops starting by Drop 1 (The Spark(not finalized)) Sketches of t-shirts below: Where will the logo be used? Firstly we’ll use it on our social media profiles / Website (when done). We will need multiple variations that will be suitable to be present on our clothing (tshirts, hoodies…) and will also be prese...

    $553 (Avg Bid)
    $553 Avg Bid
    45 bids

    ...application storyboards and use cases into functional applications - Design, build, and maintain efficient, reusable, and reliable Java code - Ensure the best possible performance, quality, and responsiveness of the applications - Identify bottlenecks and bugs, and devise solutions to these problems - Help maintain code quality, organization, and automatization - Hands on experience on spring boot spark microservices and osgi specifications - Strong knowledge of micro-service logging, monitoring, debugging and testing - Implementations experience of micro-service integration, packaging, build automation and deployment Skills - Proficient in Java, Data structures, Algorithms - Solid understanding of object-oriented programming - Familiar with various java design patterns, micros...

    $449 (Avg Bid)
    $449 Avg Bid
    9 bids

    We have opportunities for qualified Data Engineering Specialist to work for a leading telecommunications company in Sydney, Australia. We're seeking an experienced data engineering specialist who has skills and experience in implementing large scale big data platforms. Our big data / data analytics technologies: Postgresql, Apache Spark, Apache Kafka, Apache HDFS, Apache Nifi, Apache Hive, Apache Flink, Apache Druid, Scala and Python Programming language, Kubernetes(K8s)/Rancher/Docker, ELK, Internet of Things, Data Science, AI and ML Platforms

    $58 / hr (Avg Bid)
    $58 / hr Avg Bid
    13 bids

    Create a POC for data lakehouse solution using: 1. hdfs for storage, 2. deltalake, dremio to query delta lake, dremio-superset integration It should have folln features: 1. ACID support 2. data governance feature 3. Data/metadata discovery using Amundsen 4. data catalog with Apache atlas .. here Amundsen to be integrated with Atlas. 5. provi...with Atlas. 5. provision for masking/encrypting data based on role accessing the data. 6. security controls and audit. Deliverables: 1. demo showcasing all the above requirements. 2. setup instructions/scripts that will help install the POC setup. 3. any scripts used to configure the products used in solution. 4. explanation of each and every solution component used, its configuration etc. 5. spark jobs code used to showcase one end to en...

    $256 (Avg Bid)
    $256 Avg Bid
    4 bids

    The project is full-time for an ongoing period which I would discuss the details when contacted. I need a Senior Python Developer with experience in data analytics or a Senior Data Analyst; also must have experience working with two or more of these: Azure, AWS, SQL, Databricks, ETL, Scala, Spark.

    $22 / hr (Avg Bid)
    $22 / hr Avg Bid
    25 bids

    My project is about scala and spark optimization

    $16 / hr (Avg Bid)
    $16 / hr Avg Bid
    8 bids

    One should select a public data set, think about a research project for example a clustering or classification problem or any machine learning model, and implement the model using cluster computing platforms like Apache spark, and evaluate the results.

    $162 (Avg Bid)
    $162 Avg Bid
    24 bids

    ...standards to ensure quality of deliverables ● Rapidly understand and translate clients’ business challenges and concerns into a solution oriented discussion. Must Have: ● At least 6+ years of total IT experience ● At least 4+ years of experience in design and development using Hadoop technology stack and programming languages ● Hands-on experience in 2 or more areas: o Hadoop, HDFS, MR o Spark Streaming, Spark SQL, Spark ML o Kafka/Flume. o Apache NiFi o Worked with Hortonworks Data Platform o Hive / Pig / Sqoop o NoSQL Databases HBase/Cassandra/Neo4j/MongoDB o Visualisation & Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau, Pentaho o Scrapy for crawling websites o Good to have knowledge of Elastic Search o Good to have understanding of...

    $42 / hr (Avg Bid)
    $42 / hr Avg Bid
    6 bids

    Hi I am looking an expert for my data engineer project. You need to work on screen sharing on my computer. If you are expert on Big Data, Spark, ETL pipeline, Linux, Python and SQL please contact me for more details. Thanks.

    $17 / hr (Avg Bid)
    $17 / hr Avg Bid
    15 bids

    Project contains architecture diagram generator using spark

    $36 (Avg Bid)
    $36 Avg Bid
    11 bids

    Problem Statement: Design scalable pipeline using spark to read customer review from s3 bucket and store it into HDFS. Schedule your pipeline to run iteratively after each hour. Create a folder in the s3 bucket where customer reviews in json format can be uploaded. The Scheduled big data pipeline will be triggered manually or automatically to read data from The S3 bucket and dump it into HDFS. Use Spark Machine learning to perform sentiment analysis using customer review stores in HDFS. Data: You can use any customer review data from online sources such as UCI

    $42 (Avg Bid)
    $42 Avg Bid
    1 bids

    I am looking for some one who is good in SQL and Spark Scala. We are converting the Old SQL scripts into Spark Scala and Deploying them using Airflow Dags.

    $767 (Avg Bid)
    $767 Avg Bid
    18 bids

    Problem Statement: Design scalable pipeline using spark to read customer review from s3 bucket and store it into HDFS. Schedule your pipeline to run iteratively after each hour. Create a folder in the s3 bucket where customer reviews in json format can be uploaded. The Scheduled big data pipeline will be triggered manually or automatically to read data from The S3 bucket and dump it into HDFS. Use Spark Machine learning to perform sentiment analysis using customer review stores in HDFS. Data: You can use any customer review data from online sources such as UCI

    $46 (Avg Bid)
    $46 Avg Bid
    1 bids

    Looking for a big data developer proficient in python and pyspark to help me to optimize the spark stand-alone cluster configuration I have some issues doing inference using a deep learning model. That I do an inference-trained deep learning model in a distributed manner using multiple nodes based on a spark stand-alone cluster, and I need someone to discuss with him my result and review some issues that are mainly related to Spark not using all configured storage memory capacity.

    $234 (Avg Bid)
    $234 Avg Bid
    12 bids

    Need assistance to create som pyspark rdd scripts.

    $61 (Avg Bid)
    $61 Avg Bid
    8 bids

    """Here is the high level job description. • Strong AWS Glue • Strong Python programming experience. • Experienced in developing complex data transformation ETLs • Strong experience in working with Python + PySpark + Apache Spark • Strong experience of AWS cloud services related to data domain • Strong understanding of On-Prem/Cloud Data warehouse databases • Has technical leadership capabilities and can lead and deliver projects independently • Understands the impact of emerging trends in data tools, analysis techniques and data usage • Understands the concepts and principles of data modelling and can produce, maintain and update relevant data models for specific business needs • Good to have – knowledge of clou...

    $2220 (Avg Bid)
    $2220 Avg Bid
    9 bids

    ...Modelling Techniques & Data Engineering Concepts is a must Hands on experience in ETL process, Performance optimization techniques is a must. Candidate should have taken part in Architecture design and discussion. Minimum of 2 years of experience in working with batch processing/ real-time systems using various technologies like Databricks, HDFS, Redshift, Hadoop, Elastic MapReduce on AWS, Apache Spark, Hive/Impala and HDFS, Pig, Kafka, Kinesis, Elasticsearch and NoSQL databases Minimum of 2 years of experience working in Datawarehouse or Data Lake Projects in a role beyond just Data consumption. Minimum of 2 years of extensive working knowledge in AWS building scalable solutions. Equivalent level of experience in Azure or Google Cloud is also acceptable Minimum of 2 years of...

    $2698 (Avg Bid)
    $2698 Avg Bid
    17 bids

    Labelled dataset would be provided, perform Ml in GCP , GCP access will be provided if you don’t have one

    $284 (Avg Bid)
    $284 Avg Bid
    8 bids

    Hi, The project consist of making a Machine Learning Dating Matching Service (maybe one java class or one python script) that can be used for making cluster of profiles with same similitarities and preferred charactericts. The Clustering algorthims will be used on unsuper...Machine Learning Dating Matching Service (maybe one java class or one python script) that can be used for making cluster of profiles with same similitarities and preferred charactericts. The Clustering algorthims will be used on unsupervised data. I want to have the steps that can be achieves this functionnality, and sources code (python/java/scala) that make this functionnaly using ideally Spark ML, or other Machine Learning library. The input will be data of profiles that will be generated arbitrary. Reg...

    $256 (Avg Bid)
    $256 Avg Bid
    38 bids

    ...HYDROGEN (LIQUID), HYDROGEN GAS, AMMONIA (liquid Green Ammonia). FUEL SYSTEM: HIGH PRESSURE CARBURETTOR, MECHANICAL FUEL; INJECTION, ELECTROMECHANICAL FUEL INJECTION (Electromechanical), MULTI-POINT INJECTIONS COOLING SYSTEM: AIR and LIQUID-COOLED POWER OUTPUT: 1,800.00–3,600.00 bhp (1342.26–2684.52 kW) REVOLUTIONS PER MINUTES (RPM): 27,000.00 Revolution Per Minute NUMBER OF VALVES: 82 to 98 NUMBER OF SPARK PLUGS: 48 (Two per cylinder) TORQUE OUTPUT: ____________________________________________________________________________________________________________ 13 SPEEDS EXTREME HEAVY-DUTY TRANSMISSION I want to Design a fully functional Rendering design of a 13 SPEEDS EXTREME HEAVY-DUTY TRANSMISSION that will works in paramount mechanical terms with that W24 ENGIN...

    $1559 (Avg Bid)
    $1559 Avg Bid
    16 bids

    Data Engineers 6+ yrs : At least 6+ years of total IT experience ● At least 4+ years of experience in design and development using Hadoop technology stack and programming languages ● Hands-on experience in 2 or more areas: o Hadoop, HDFS, MR o Spark Streaming, Spark SQL, Spark ML o Kafka/Flume. o Apache NiFi Worked with Hortonworks Data Platform o Hive / Pig / Sqoop o NoSQL Databases HBase/Cassandra/Neo4j/MongoDB o Visualisation & Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau, Pentaho o Scrapy for crawling websites o Good to have knowledge of Elastic Search o Good to have understanding of Google Analytics data streaming. o Data security (Kerberos/Open LDAP/Knox/Ranger) ● Should have a very good overview of the current landscape...

    $2831 (Avg Bid)
    $2831 Avg Bid
    2 bids

    Need a new professional logo made for my automotive electrical company. Details are: Bright Spark Automotive Electrical & Marine or Automotive & Marine electrical or Marine and Automotive Electrical what ever flows the nicest and looks the best, would like it to be high quality and professional but subtle and eye catching, i offer a quality service and need a logo to reflect that :)

    $73 (Avg Bid)
    $73 Avg Bid
    183 bids

    I need to calculate billable one-on-one Skype hours (my own account) every months or so. IT IS NOT A SCRAPER JOB AND NOT DATA MINING! What I need is a working Excel VBA code so data entry professionals please don't volunteer unless you know how ...with a selected client. I need the start and the length of session(s) with the client, complete with any text messages sent or received (+sending times), for proper billing. I prefer the use of Excel VBA and looping through HTML elements to conveniently interfere if a maintenance was needed. I like to see under the hood so please write the code with some notes to let me see where to 'change the spark plug'. Please note that I NEED THE SOURCE code for performing maintenance. I have many project ideas. Please note that I...

    $29 (Avg Bid)
    $29 Avg Bid
    7 bids

    I need this website redone. The other menu items I need from the site: 1. About US 3. 2023 Contract Request.

    $208 (Avg Bid)
    $208 Avg Bid
    80 bids

    Hi All, Need Azure data engineer who know and experience in with Good knowledge of Azure data bricks, Azure data factory and spark Budget will be as mentioned in the BID only. Higher budget bid will cancel immediately. More details will be in chat. If you agree below terms then only reply otherwise don't waste my and your time. ( Note : Only Individuals please. Agency are welcome who are ready to work with mentioned budget only) ( I have already mention about working hour so don't ask this question again in chat. In between if you are free then you can do other work as well ) This is resource base work so you have to available Mon to FRI ( full time ). Any one looking for project base work then don't bid here and don't waste both time please. NDA will be si...

    $844 (Avg Bid)
    $844 Avg Bid
    3 bids

    The project duration is 3-4 days. It involves creating a limited number of interview questions for the subject areas. We need freelancers in all the following areas: 1. AWS, AZURE & GCP 2. SPARK, Hive, Pig 3. PYTHON & R Programming 4. SCALA 5. Shell Script/Bas, Kafka, Storm, Rabbit MQ 6. AI & ML 7. DevOps Engineer 8. Cyber Security 9. SQL 10. Data Scientist

    $408 (Avg Bid)
    $408 Avg Bid
    13 bids

    The project duration is 3-4 days. It involves creating a limited number of interview questions for the subject areas. We need freelancers in all the following areas: 1. AWS, AZURE & GCP 2. SPARK, Hive, Pig 3. PYTHON & R Programming 4. SCALA 5. Shell Script/Bas, Kafka, Storm, Rabbit MQ 6. AI & ML 7. DevOps Engineer 8. Cyber Security 9. SQL 10. Data Scientist

    $27 - $227
    Featured Urgent Sealed
    $27 - $227
    7 bids

    ...to it. If you are interested in being a co-founder let me know and we can discuss details. Need to be in the U.S. Example tech stack may include: Programming languages: HTML5/CSS3 Frameworks: Node.js, React Databases: MySQL Cloud platforms: Amazon EC2, Amazon S3 Analytics: Google Mobile App Analytics, Flurry Analytics, Hadoop, Hive, MixPanel, Localytics, Mode, Parquet, Pig, Presto, Spark CDN services: Amazon CloudFront Streaming protocols: RTMP, Adobe HTTP Dynamic Streaming, Apple HTTP Live Streaming, M2TS, MPEG-DASH, Microsoft Smooth Streaming, WebRTC, RTSP/RTP Media formats: MKV, MP4, AVCHD, AVI, DMW, MOV, FLV, WMV, SWF Codecs: H.264/AVC, FFmpeg, XviD Media containers: MP4, FLV Geolocation: Google Maps API, MapKit/Core Location frameworks (for iOS) Chat: Twi...

    $72 / hr (Avg Bid)
    NDA
    $72 / hr Avg Bid
    41 bids

    There are three different problems that you must solve. The first two problems the datasets and problem statement are given to you. The last problem is open ended where you must obtain a machine learning challenge online and solve it. 1. Problem 1 The “” dataset has historical data on individuals that eventually either developed diabetes or not. Diabetes is a condition where the body does not produce enough insulin to break down the food that you eat. Without medication, diabetes can lead to damage to cells and vital organs and eventual death. In this problem, we want to predict whether a person is at risk of becoming diabetic based on the individual’s data. This information can then be used to begin preventative measures for the individual (example lifestyle change in di...

    $11 - $34
    $11 - $34
    0 bids

    start a new business to sell Himalayan Salt, I'm looking for a very creative Logo and label design to stick on Plastic bags size 1Kg and 1/2 Kg which give spark to compete in a fast growing market with strong competition. Product Name is Pink Himalayan Salt and Brand Name is ALAFAF and add to the sticker design some of the benefits of Himalayan Salt Uses beside its organic 100%. I attached Pics of plastic bag 1kg Note: The color combination must be creative so salt color be clear in appearance Build a a logo and design for Product label sticker

    $45 (Avg Bid)
    $45 Avg Bid
    63 bids

    I looking for Talend Spark Streaming jobs design expertise to explain me the few Spark jobs on Talend environment.

    $26 (Avg Bid)
    $26 Avg Bid
    1 bids

    Hi Dusko, I have a few modifications on the Lie Detector project. I seem to fight with KiCad on the pads and PCB cuts. I had more success with Design Spark. I made a few revisions to the PCB and would like 22mm oval touchpads on the sides instead of the bottom of the PCB. I'm not sure how to get them on both sides in sliver layer. I'll send my files and you will see what I was trying to do. Will this work for you?

    $22 (Avg Bid)
    $22 Avg Bid
    1 bids

    I am looking to create a dating app that mainly focuses on video calls (60sec speed dates) rather than profiles. I am looking for someone who is experienced with video calls, profile creation, location based searches, ...dates) rather than profiles. I am looking for someone who is experienced with video calls, profile creation, location based searches, chat features, and secure payment. I am looking to make a smooth, attractive app with nice flow and features. Features: chat bubbles with live feed / refresh rate,navigation bar profile/call history and text chat/ video call availability/ search/ settings,random spark calls/ invitations scroll bar/ video chat room (almost like a zoom meeting with extra features such as vote to kick) Will need both Android and iPhone apps. Budget u...

    $4550 (Avg Bid)
    NDA
    $4550 Avg Bid
    95 bids

    I want a person that understand 100% the cop-k-means algorithm. As you know, it's an iterative algorithm and it takes a lot of time to calculate a big amount of data. The purpose of this project is to program the algorithm in pyspark to make it able to BIG DATA (using spark functions and paralleling processes). Also, the efficiency and the validation of constraints is important for this problem.

    $275 (Avg Bid)
    $275 Avg Bid
    26 bids

    Hi, We have frequent AWS related tasks those are smaller in nature like: 1- Setting up EC2 instance (example: Task #1) 2- Setting up Spark EMR (example: Task #2) 3- Writing small ETL job to fetch one public sample data set (example: Task #3 and so on. Each task can be completed within 15-30 minutes if you have right skill set. For each task the budget is 10$.

    $78 (Avg Bid)
    $78 Avg Bid
    17 bids

    Designation- Developer Min 5 years of Experience in AWS cloud, Redis database, and developing spark scala ETL workflows. Spark scala will be the primary requirement We need to work on the scala backend with API development Need to build scala scripts for the business requirements Need ETL workflow and help in migration generation part. Need support daily 2 hours Budget: 25-35k INR Per Month Experience:- 5+ Yrs For apply dm me

    $660 (Avg Bid)
    $660 Avg Bid
    4 bids

    Top spark Community Articles