Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
Morton County
...The School Reorganization Board is responsible for hearing any requests, and providing a recommendation, from county patrons and/or... ...final action. An appointment is for a term of 3 years and board members may serve for more than one term. Deadline for application is...
Bullock Protection LLC
...Job Posting: Armed Security Officer Bullock Protection LLC Job Description Bullock Protection LLC, a leader in private security services, is currently seeking to fill a role for a dedicated and vigilant Armed Security Officer. The chosen candidate will be part...
Zone IT Solutions
...We are looking for ETL Developers for a large-scale project. This is a permanent role with a global IT service leader. Requirements Strong experience in ETL Development. Minimum of 5+ years of experience in Informatica Cloud or Enterprise Informatica. Proficiency...
GreatAuPair LLC
We need morning care to drop off the twins at pre school then afternoon care to pick them up and keep them entertained until bed time routine (which you will begin 6:30-7p) and put them to bed. M-F
Lincoln Electric
...Lincoln Electric is the world leader in the engineering, design, and manufacturing of advanced arc welding solutions, automated joining... ...Summary Lincoln Electric has an exciting opportunity for a Robotic Automation Engineer. The Robotic Automation Engineer will implement...