Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
ShalePro Energy Services
...equipment to perform integrity management and regulatory tasks on oil or liquids pipelines Monitor activity in and around pipeline... ...Respond to pipeline emergencies; perform cleanup associated with field ops and corrosion control activities . Qualifications The...
SCALIS Careers
...Title: Investment Banking Analyst Location: Remote About the job Role Overview: We are seeking experienced investment banking professionals to collaborate with a leading AI research lab on a long-term project focused on training and refining large language...
Airgas
...diverse and inclusive workplace that embraces the diversity of our employees, our customers, patients, community stakeholders and cultures across the world. Airgas is Hiring for a Customer Service Coordinator in Billerica, MA! We are looking for you ! In-Office...
Skilled Trades Services
Skilled Trades Services is currently looking for Pipe Welders for Muscatine, IA area. Must be able to start ASAP. Must have 5 years of welding experience and show it on a resume in order to be considered for the position . This is an AG industrial site, will be doing ...
System One
Job Title: IT Desktop Support Technician Location: El Dorado, Arkansas Type: Contract Contractor Work Model: Onsite Hours: 7 AM-... ...outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without...