Python developer with Spark AWS Job at Conch Technologies Inc, Columbus, OH

SFF3bGRzTVBKZ3BPLzZseWZldkNXYnp1Wmc9PQ==
  • Conch Technologies Inc
  • Columbus, OH

Job Description

Hi

Greetings from Conch Technologies Inc

Job Title: Python Spark AWS

Location: Columbus OH nonlocal candidates accepted

Duration: 12 Months COntract or Direct Fulltime

Job Responsibilities:

Develop and maintain data platforms using Python Spark and PySpark.
Handle migration to PySpark on AWS.
Design and implement data pipelines.
Work with AWS and Big Data.
Produce unit tests for Spark transformations and helper methods.
Create Scala/Spark jobs for data transformation and aggregation.
Write Scaladocstyle documentation for code.
Optimize Spark queries for performance.
Integrate with SQL databases (e.g. Microsoft Oracle Postgres MySQL).
Understand distributed systems concepts (CAP theorem partitioning replication consistency and consensus).

Skills:
Proficiency in Python Scala (with a focus on functional programming) and Spark.
Familiarity with Spark APIs including RDD DataFrame MLlib GraphX and Streaming.
Experience working with HDFS S3 Cassandra and/or DynamoDB.
Deep understanding of distributed systems.
Experience with building or maintaining cloudnative applications.
Familiarity with serverless approaches using AWS Lambda is a plus

With Regards



Teja Maripeti

Desk:

Email: t

Web:

Job Tags

Full time, Contract work,

Similar Jobs

Legacy Health

RN Staff Nurse - Operating Room Job at Legacy Health

 ...direction of the clinical manager or designee as defined by the relevant Standards and Scope of Practice for the Registered Nurse. The RN Staff Nurse assesses, analyzes, plans, implements and evaluates patient care following established patient care standards for Legacy... 

Sanford Health

Clinical Care Leader (RN) - Internal Medicine - Broadway Clinic Job at Sanford Health

 ...evaluation) to provide individualized nursing care to patients. Responsible for the coordination of care, patient assessment, patient education, triage, and various other nursing interventions. Collaborates with other inter-professional colleagues, including physicians, to... 

Crane Home Care Inc

PCA/HHA Job at Crane Home Care Inc

NOW hiring certified PCAs and HHAs. OFFERING DAILY PAY -GET PAID AS SOON AS YOU A CLOCK OUT! We are looking for energetic, experienced, caring aides who can be a trusted companion that feels like family, providing their clients with the care and support of... 

Sanford Health

RN Inpatient - SMCF Post-Anesthesia Care Unit Job at Sanford Health

Create Your Career with Us As one of the largest not-for-profit health systems in the United States, Sanford Health is always looking to innovate and grow. Grow with us by joining our team of over 18,000 nurses. Our workplace culture focuses on treating patients...

Loomis

No CDL Required, Loomis Armored Car Driver No Exp Needed Incentive for Military Exp Job Job at Loomis

No CDL Required, Loomis Armored Car Driver No Exp Needed Incentive for Military Exp JobLoomis is seeking drivers for daily routes in the Denver Metro area. This position averages 40 - 50 hrs.. per week. Weekly schedule is 4 days per week 10-12 hours per day. As a Loomis...