Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
Bowman Consulting Group, Ltd.
Oversee and manage LiDAR and UAS projects from initiation to completion. Identify new business opportunities, develop proposals, and build and maintenance client relations.
AIG
Who we are American International Group, Inc. (AIG) is a leading global insurance organization. Building on 100 years of experience, today AIG member companies provide a wide range of property casualty insurance, life insurance, retirement solutions, and other financial...
Careerscape
...Responsibilities Review medical records and assign ICD and CPT codes Ensure coding accuracy and compliance with guidelines Abstract clinical information from documentation Query physicians for clarification when needed Stay current with coding updates and changes...
Aloft New York Downtown Financial District
**Job Title: Engineer Manager****Location:** [Location]**Job Type:** Full-Time **About Us:** We are a forward-thinking organization dedicated to innovation and excellence. Our team is passionate about delivering high-quality engineering solutions that meet the demands...
Farm Job Search
...center pivot irrigation systems powered by large 3 phase electric motors. $50,000 to $65,000 per year DOE. Less than 30 minutes from the state capitol and jobs for a spouse. Beautiful country near the Missouri River for hunting, fishing, boating and water sports....