Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
Aegis Manufacturing & Engineering
...The Mechanical Engineer will utilize expertise in equipment design, modification, and computational fluid dynamics.This role focuses... ...improving system performance, efficiency, and reliability in industrial and manufacturing environments through data driven decisions....
Domino's Franchise
Domino's Pizza Store offering carryout and delivery services. Hiring all positions. Additional Information All your information will be kept confidential according to EEO guidelines.
Folsom State Prison
...Duties ALL HIRES ARE SUBJECT TO HIRING FREEZE AND/OR BUDGET APPROVAL Under the direct supervision of the Correctional Case Records Supervisor, the Correctional Case Records (Analyst) performs specialized analytical case records date/time calculations and inmate...
ABC Imaging
...Locations in USA, London, Dubai, and Shanghai. One Stop Solution. Position Summary: ABC Imaging is currently seeking a Document Scanning Technicianto join our team. The ideal candidate will have 2-3 years of experience in document scanning, proficient in handling...
Allmed Staffing Inc
*Patient Care Coord* Contract *Dallas, TX* Work location: UHG Optum 2301 S Hampton Rd, Ste 900, Dallas, TX 75224 Work hours: 40 hrs a week Position background: Patient facing rooming patients, The team consists of 27 staff 7 Physicians each physician has 1 MA...