Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
NHBlacklabs Delivery
...Drivers to join our dynamic crew! We're partnering with giants like Amazon to deliver packages safely and swiftly to homes and businesses... ...service we're obsessed with exceeding expectations!- Drive safely in all weather, solve on-the-spot challenges, and maintain...
KBR
...the area of operation.+ Be able to read and understand signs and orders applicable to the operation of the equipment.+ Must pass overseas medical screening and be in good health.+ Must have a valid county of origin driver's license and can operate assigned heavy...
South Orange County Community College District
...within the job. SUMMARY DESCRIPTION Perform a variety of law enforcement and security related duties to ensure the safety of students... ...required to contribute to the California Public Employees Retirement System (CalPERS), through payroll deduction. The SOCCCD does...
International Paper
Data Governance Sr. AnalystDescription:**Position Title:****_GFIM Data Governance Sr. Analyst_****Pay Rate** :**_$86,000-$110,000 per year_**_Multiple factors, including Individual experience, skills and abilities will determine where an employee is ultimately placed...
Parks Auto Parts
Welcome to Parks Auto Parts! We've served the Charleston, Columbia, Hilton Head and Myrtle Beach areas since 1946. Parks Auto Parts is a growing leader in aftermarket auto parts distribution and are looking for qualified people to join our team. We are South Carolina's...