Sr. Hadoop Developer Job at Purple Fly Solutions, Delaware, OH

RkxDWENBdUVKbWdWem1IMHlZMjdkSFJrREE9PQ==
  • Purple Fly Solutions
  • Delaware, OH

Job Description

- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.

Job Tags

Contract work,

Similar Jobs

Chenega Corporation

Security Police Officer Job at Chenega Corporation

**Summary**The **Security Police Officer** provides first response to emergencies; enforcing federal law and assimilated state law; conducting mobile patrols, inspections and searches; conducting traffic enforcement and traffic investigations; initiating an arrest and... 

American International Contractors, Inc.

Project Controls Engineer Job at American International Contractors, Inc.

American International Contractors (Special Projects), Inc. (AICI-SP) is currently seeking a Project Controls Engineer candidates to work on a U.S. Embassy design/build project in Doha, Qatar. An active U.S. Secret Level Security Clearance is a requirement for this... 

Analytica

Azure Data Engineer Job at Analytica

Analytica is seeking a technically skilled Azure Data Engineer to lead the administration, integration, and technical optimization of our clients Microsoft Purview environment. In this hands-on role, you will own the end-to-end management of the Purview platform, enabling... 

J Rose Logistics

Local CDL-A Dedicated Driver | Home Daily Route Job at J Rose Logistics

 ...REQUIREMENTS -must have at least 12 months recent Class A experience -must have HAZMAT endorsement-must live within 50 miles of Gastonia, NC -no SAP drivers JOB DETAILS -home daily (possible overnight layovers periodically)-$500 SIGN ON BONUS -... 

RTX Corporation

Mechanical Engineer (Onsite) Job at RTX Corporation

 ...a difference at RTX.This position is for an entry level Mechanical Engineer to support the CBMS II and CAMS product lines based in San...  ...developing, testing and troubleshooting.+ You will gain hands on experience with technologically advanced equipment.+ You will broaden...