Job Description
- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.
Job Tags
Contract work,
Similar Jobs
TLC Healthforce
Embark on a transformative journey as a Travel PICU Registered Nurse in State College, Pennsylvania, where your expertise will lift the most vulnerable patients during their most critical moments. In this highly specialized role, youll partner with seasoned physicians...
AIG
Who we are American International Group, Inc. (AIG) is a leading global insurance organization. Building on 100 years of experience, today AIG member companies provide a wide range of property casualty insurance, life insurance, retirement solutions, and other financial...
City and County of San Francisco
...line work in the installation, maintenance, and repair of transit power systems including trolley overhead contact wires, poles,... ...weather; may be required to work overtime; this is a 7 day / 24 hour operation. Qualifications Education : Completion of a State...
Brandcoven
...Position: Data Entry Clerk Location: Remote, United States Job Type: Part time/Full time Company Overview: Brandcoven is a leading marketing and branding agency that specializes in helping businesses build their brand and reach their target audience...
Schneider Electric
...What will you do? The Process Operator tends machinery and equipment that rivets, installs working parts, assembles, inspects, check tests, repairs and packs single pole style electrical breakers. The Process Operator also performs manual part assembly on a production...