Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
Goodwill Industries of San Diego County
...assists in stocking the floor and pulling merchandise. Opens and closes donations area. Accepts and safeguards donations and keeps processing and donation areas in a clean, safe and organized manner. Provides excellent customer service to donors and customers....
SURGE Staffing
...Position Summary We are seeking a dependable and safety-focused Forklift Operator / Material Handler to support daily warehouse... ...Operate forklifts and material handling equipment (sit-down, stand-up, reach truck, pallet jack, as applicable) in a safe and efficient manner...
Bayer
...At Bayer we're visionaries, driven to solve the world's toughest challenges and striving for a world where 'Health for all Hunger for none' is no longer a dream, but a real possibility. We're doing it with energy, curiosity and sheer dedication, always learning from unique...
TekCom Resources
...Supervisor, Network Evolution , high-split, Spectrum, HFC, Coax Cable, HFC Inspector, Hybrid Fiber Coax , Coax, Outside Plant Field... ..., make ready, cable placement, Aerial, NESC Fiber Optics. Data collection, bucket truck, Utilities, CATV, Syracuse, NY #Tekcomjobs...
Liberty Personnel Services, Inc.
...Job Details: Sales Engineer A client of ours is seeking an experienced Sales Engineer to support and grow an established industrial customer base in Illinois. This role focuses on developing long-term client relationships, identifying operational needs, and delivering...