Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
American Red Cross
...provide Paid-Training no prior medical experience required. Prior warehouse or inventory experience a plus! Joining The American Red Cross is like nothing else its as much something you feel as something you do. You become a vital part of the worlds largest...
TD Bank
...Work Location: North Haven, Connecticut, United States... ...the salary range over time as they progress in... ...complete Teller training and part 1 of platform training... ...thrive both at work and at home. Colleague... ...as well as access to an online learning platform and a...
Insight Global
...Job Description Insight Global is seeking a dynamic professional with proven Project Management expertise, including experience as a Project Manager and a strong understanding of organizational change. The role involves building key milestones within change plans...
MBM Logistics
...Job description: Now Hiring: OTR Owner Operators (85% Gross Pay) Marvel Logistics Inc. A semi-truck driving through a vast desert... ...with Dry Van, Reefer, Flatbed, Hot Shot , Car Hauler , or Power Only* equipment, we want to partner with you. WE DO NOT WORK...
STERIS - Commercial Operations
...At STERIS, we help our Customers create a healthier and safer world by delivering innovative healthcare and life science products and services worldwide. A day in this role You start your day from home, schedule in hand, heading to a hospital where clinical teams...