Sr. Hadoop Developer Job at Purple Fly Solutions, Delaware, OH

RkxDWENBdUVKbWdWem1IMHlZMjdkSFJrREE9PQ==
  • Purple Fly Solutions
  • Delaware, OH

Job Description

- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.

Job Tags

Contract work,

Similar Jobs

Fairview Medical Group, LLC

Medical Assistant Job at Fairview Medical Group, LLC

 ...Currently looking for a full-time Medical Assistant to work back office at a very busy high paced multi-physician Internal Medicine Practice. Must be able to multitask and have a positive attitude as well as be a team player. This is a professional position so attire and... 

KLDiscovery

Remote Litigation Data Analyst 2nd Shift Job at KLDiscovery

 ...leader in eDiscovery, compliance, and data management solutions, empowering law...  ...are looking for a Litigation Data Analyst to join our team who is passionate about...  ...place to grow your career. Work Status: Remote, work from home opportunity. 2nd Shift, Monday through... 

Cristo Rey Jesuit High School Milwaukee

Annual Fund & Grants Manager Job at Cristo Rey Jesuit High School Milwaukee

The Annual Fund Manager is a 12-month, full time position that is primarily responsible for the development and management of a comprehensive...  ...integrity and utilization, and execution of departmental grant writing/reporting activities. The Annual Fund Manager works closely... 

OceanaGold

Engineer- Mining Job at OceanaGold

 ...We are looking for a motivated Mining Engineer to join our Technical Services team at Haile which provides technical work for both the Underground and Open Pit operations. This role will initially report to the Open Pit Engineering team. We believe in fostering the... 

Logix Built Solutions Limited

UI/UX Designer Job at Logix Built Solutions Limited

# Create user-centric designs for web and mobile applications. # Develop wireframes, prototypes, and mockups...  ...design elements across products (style guides, UI components). # Stay updated with the latest trends in UI/UX design, mobile, and web technologies . #...