Sr. Hadoop Developer Job at Purple Fly Solutions, Delaware, OH

RkxDWENBdUVKbWdWem1IMHlZMjdkSFJrREE9PQ==
  • Purple Fly Solutions
  • Delaware, OH

Job Description

- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.

Job Tags

Contract work,

Similar Jobs

Liberty Personnel Services, Inc.

SQL Developer (SSIS, ETL, APIs, c#) Job at Liberty Personnel Services, Inc.

 ...Job Details: Job Title: SQL Developer (SSIS, ETL, Stored Procedures, API, c#) NO C2C, NO THIRD PARTIES, NO SPONSORSHIP Location: East Chicago Job Type: Full-time We are seeking a talented and experienced SQL Developer to join our team! The ideal candidate... 

Re Focus LLC

UX Writer Job at Re Focus LLC

 ...knit team. Nice to have: Figma Familiar with AI platforms-not required Want candidates that work in the UX space, creating websites and/or mobile apps. Writers from the advertising/creative side who have digital experience would also be qualified for what we need.... 

Pinnacle Way Of Life

Project Manager-Remote-Independent Job at Pinnacle Way Of Life

 ...beginners Individuals who require constant direction or external motivation Those uncomfortable with accountability or self-management Next Step Apply only if this resonates. The next page includes a short questionnaire to confirm alignment and... 

Cigna

Home Infusion Nurse, Per Diem - Accredo - Rutland, VT Job at Cigna

 ...This position is anticipated to need around 5-15 hours per week. Home Infusion Registered Nurse Accredo Specialty Pharmacy Join Accredo...  ...techniques. Valid drivers license and ability to travel within a large geographic region. Ability to do multiple... 

MH Energy

Class A Water Hauling to the Oil Fields Job Job at MH Energy

Class A Water Hauling to the Oil Fields JobWater hauling to the oil fields, local routes. Pay: $91,500 - $102,750 Annual. Hourly pay plus overtime after 40 hours. Raise after 90 days.Employee and family health benefits, retirement package, newer trucks, double pay...