Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
Millennium Systems International
...response to software releases, enhancements, and policy updates Evaluate and refine training courses and learning experiences to ensure... ...As part of our benefits, we offer unlimited access to Udemys online courses, helping you refine your skills, explore new areas, and...
NBCUniversal
...entertainment and news brands, including NBC, NBC News, MSNBC, CNBC, NBC Sports, Telemundo, NBC Local Stations, Bravo, USA Network, and Peacock,... ...professionals and business executives regarding employment laws and support the overall employment legal group, as well as...
NOFS
Job Summary:NOFS (Northern Ohio Field Services) is currently seeking an experienced Mortgage Inspector to join our growing team in Smith County MS. As a Mortgage Inspector at NOFS, you will be responsible for conducting inspections on residential properties to ensure...
Johnson Controls
...working experience in the HVAC plumbing, pipefitting and/or mechanical equipment service industry. You may be required to pass a satisfactory... ...or willing to join the United Association of Journeymen and Apprentices of the Plumbing and Pipe Fitting Industry of the United...
Aerotek
...responsible for accurately sorting boxes, arranging them on the correct pick pallet for forklift operators, and handling products of various... ...on the correct pick pallet for forklift operators.+ Pick and pack products of various sizes using lifting equipment.+ Utilize RF...