Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
Qualcomm
...General Summary:We're looking for a motivated Product Manager to join our Developer Relations team. In this pivotal role, you'll focus on shaping Developer Relations advocacy efforts, ecosystem development and scaling. In this role you will play a pivotal role in engaging...
AIG
Who we are American International Group, Inc. (AIG) is a leading global insurance organization. AIG member companies provide a wide range of property casualty insurance in approximately 70 countries and jurisdictions. These diverse offerings include products and ...
GCJ INC/KTS SUBS
Job OverviewResponsibilities~Open saturday and Sunday rotations. Set up grill and start breakfast~Get grill switched over to lunchSkills~self motivated and quickBenefits
WakeMed Health & Hospitals
Overview:The Ambulatory Care Nurse, Infusion is responsible for providing physician support and as applicable, comprehensive nursing care to patients and their families. This RN position is responsible for providing skilled, exceptional patient care through the administration...
SGS Consulting
...sorting information. Compile, verify accuracy, and sort paper-based data. Transfer paper-based data into electronic format in Microsoft Excel. Review data for deficiencies or errors, correct any incompatibilities. Maintain confidence by keeping information confidential...