Sr. Hadoop Developer Job at Purple Fly Solutions, Delaware, OH

RkxDWENBdUVKbWdWem1IMHlZMjdkSFJrREE9PQ==
  • Purple Fly Solutions
  • Delaware, OH

Job Description

- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.

Job Tags

Contract work,

Similar Jobs

Blue Stone Management

Project Coordinator Job at Blue Stone Management

 ...timeline moving: Develop and maintain summary-level schedules using Microsoft Project, ensuring key milestones are clearly tracked and...  ...presentations for internal teams and stakeholders using PowerPoint and Excel. Champion process and quality: Ensure contracts,... 

Bayer

Tech Agronomist III: New York/ New England Job at Bayer

 ...At Bayer we're visionaries, driven to solve the world's toughest challenges and striving for a world where 'Health for all Hunger for none' is no longer a dream, but a real possibility. We're doing it with energy, curiosity and sheer dedication, always learning from unique... 

GIA Legacy Planning

Remote Insurance Agent - Work from Anywhere Job at GIA Legacy Planning

 ...Remote Insurance Agent Work Remotely Company: GIA Legacy Planning Location: Remote Position/Work from Home Job Type: Uncapped Commission| Full-Time | Part-Time Are You Ready to Take Control of Your Career? We are looking for motivated and driven individuals... 

Bayer

Sr Data Scientist, AI Job at Bayer

 ...At Bayer were visionaries, driven to solve the worlds toughest challenges and striving for a world where 'Health for all Hunger for none is no longer a dream, but a real possibility. Were doing it with energy, curiosity and sheer dedication, always learning from unique... 

SourceWhale

SDR Manager - US Job at SourceWhale

 ...named by the Sunday Times as one of the Best Places to Work in the UK, were looking for an SDR Leader to continue this momentum. We're now on the lookout for our next SDR Manager! This is an exciting opportunity to lead, coach, and scale a high-performing SDR function...