Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
Dropoff, Inc.
...the resources they need to satisfy customers and achieve their goals. Advantages of Contracting with Dropoff Non-CDL 26 ft truck work. Must provide own vehicle and insurance. Daily routes. Paid by the delivery. Requirements: ~ DOT certified ~21...
CalOpps
...oriented individuals to join our team! As an Administrative Aide (Part-time, Hourly City Worker), you will interact with a broad range of... ...hourly, at-will position that involves working approximately 15-25 hours per week, not to exceed 29 hours in a week, or 1000...
CA State Lottery
...Job Description and Duties Under the general supervision of the Lottery Ticket Sales Supervisor, the Lottery Ticket Sales Specialist is responsible for developing Scratchers ticket orders to meet the prescribed sales projections for an assigned group of retailers daily...
SunEnergy1
...Position Overview The Builder / General Contractor is responsible for managing the planning, coordination, and execution of high-end residential and commercial construction projects from concept through completion. This role oversees all aspects of project delivery...
UPMC Presbyterian
...different sleep centers at Mercy Hospital, Montefiore Hospital, and Monroeville Outpatient. Working only one Friday weekend shift a month, this role is a night shift, with three 12-hour shifts from 7pm-7am-no holidays! We also offer full time benefits for this 36 hour per...