Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
Amaray Care
...and stand for (sometimes) a long period of time ~ Experience working with clients who have a form of paralysis Schedule : Weekends (Saturday and Sunday) 10:00 a.m. - 7:00 p.m. Our employees enjoy a work culture that provides flexible schedules, working...
SLA Worldwide
...Job Description: Web & Graphic Designer Location: Nashville, TN Reports to: Marketing Manager About SLA Worldwide: SLA Worldwide is a dynamic agency specializing in elevating restaurant and retail brands through innovative marketing, digital storytelling, and...
Amazon Data Services, Inc.
...requires the successful candidate report to a site location. As a Data Center Network Technician, you will work in a dynamic... ...outside traditional work area may be requested Troubleshooting cabling infrastructure connectivity issues, including patch panels and patch...
Lensa
...performance, location and salary range at the time of the offer. Responsibilities As the Director of Partnerships & Organizational Development, you will support the Marillac Mission Fund's (MMF) strategic integration of CPPS Mission Fund by developing partnership...
Amazon.com Services LLC
...? Answer yes to any of these and you will fit right in here at Amazon Robotics (AR). We are a smart team of doers that work passionately... ...support you need to invent with us in ways that are rewarding, fulfilling and fun. The Robotics Supply Chain organization sources a...