Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
bp
...Job Description: Role Synopsis Responsible for the general upkeep and maintenance of all facilities and equipment, including pipeline right-of-way, and gather or storage areas, including but not limited to excavating, repairing, coating and backfilling pipelines,...
EPAGA Home Care
Seeking part time, flexible, skilled Private Duty Nurse for care of 100% dependent, non-verbal young adult. Tasks include but are not limited to management of daily ordered medical and therapy interventions, medication administration and feeding through G-tube and assistance...
Domino's Franchise
...you like money in your pocket? Domion's Pizza drivers are paid cash nightly, which includes; tips and mileage reimbursement. All together... ...Benefits Flexible Schedules Compteitive Wages Cash paid daily (mileage& tips) Paid Training with Potential Bonus Earnings...
Harbor Health
...Harbor Health looking for skilled Medical Assistants (MAs) to become a member of our team. Harbor Health is an entirely new multi-specialty clinic group in San Antonio, TX utilizing a modern approach to co-create health with those who get, give, and pay for it, allowing...
Stafford Gray
...Position Overview The Senior Data Warehouse ETL/BI Developer is responsible for designing, developing, enhancing, and maintaining enterpriselevel data warehouse applications within a largescale Teradata environment. The role supports complex data initiatives across...