Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
ITG Communications, LLC
...Job Description The HDD Locator will operate various types of locators including Subsite and Falcon. This position requires good knowledge of safely operating equipment around live utilities in the underground/telecom utility field. The candidate must have full knowledge...
Dynamics ATS
...Houston, TX Type of Employment Contract-to-Hire Employer Info Our client is a manufacturer specializing in subsea pipeline components and forged products. Job Summary This position is responsible for working in a manufacturing environment to...
AIG
Who we are American International Group, Inc. (AIG) is a leading global insurance organization. AIG member companies provide a wide range of property casualty insurance in approximately 70 countries and jurisdictions. These diverse offerings include products and ...
Stafford Gray
...Position Overview The Senior Data Warehouse ETL/BI Developer is responsible for designing, developing, enhancing, and maintaining enterpriselevel data warehouse applications within a largescale Teradata environment. The role supports complex data initiatives across...
USIC Locating Services, LLC
...our strong commitment to quality and safety. We are Americas leader in underground utility damage prevention and advanced infrastructure services, performing more than 84 million locates each year for the more than 1,400 telecommunications, electric, gas, water, and...