Sr. Hadoop Developer Job at Purple Fly Solutions, Delaware, OH

RkxDWENBdUVKbWdWem1IMHlZMjdkSFJrREE9PQ==
  • Purple Fly Solutions
  • Delaware, OH

Job Description

- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.

Job Tags

Contract work,

Similar Jobs

Socotec

Principal, Nuclear Engineering Job at Socotec

 ...the US, and a staff of 1,700 professionals. We provide expert engineering, inspection, and consulting services to help our clients improve...  ...SOCOTEC is seeking a mid-career professional to lead our US Nuclear Services Group, consisting of approximately 10 engineers, material... 

Robert Half

Data Entry Clerk Job at Robert Half

Description We are looking for a meticulous and detail-oriented Data Entry Clerk to join our client on a contract basis in San Ramon, California. In this role, you will be responsible for managing and inputting accurate data into our systems, ensuring the integrity of ...

Cloud Analytics Technologies LLC

ETL Developer/Administrator Job at Cloud Analytics Technologies LLC

 ...Required Skills & Experience (Must-Have)5+ yearsof hands-on experience withInformatica ETL Administration(installation, configuration, support) andETL workflow development. Proven expertise withInformatica PowerCenterandPowerExchange. Experience withWeb... 

Trinity Employment Specialists

Industrial Setup Mechanic Job at Trinity Employment Specialists

 ...for interview tips and many job opportunities! * Repair, install, adjust, or maintain industrial production and processing machinery or refinery and pipeline distribution systems. May also install, dismantle, or move machinery and heavy equipment according to plans.

ExxonMobil

Pipeline Operator Job at ExxonMobil

 ...healthcare, housing, education and workforce development. What role you will play in our team ExxonMobil is seeking a Midstream Pipeline Operator located in Carlsbad, NM. Midstream Pipeline Operator's play a key role in maintaining and documenting key data, while...