Sr. Hadoop Developer Job at Purple Fly Solutions, Delaware, OH

RkxDWENBdUVKbWdWem1IMHlZMjdkSFJrREE9PQ==
  • Purple Fly Solutions
  • Delaware, OH

Job Description

- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.

Job Tags

Contract work,

Similar Jobs

Randstad Technologies

UX Writer/Content Strategist Job at Randstad Technologies

 ...type: Contract salary: $55 - 56 per hour work hours: 8am to 5pm education: Bachelors Responsibilities Write and edit UX copy for web and mobile experiences, including navigation, user flows, and transactional content. Translate complex financial concepts... 

USAA

Compliance Analyst Intermediate Job at USAA

Compliance Analyst Intermediate Location Hybrid remote in Plano, TX : Why USAA? Let's do something that really matters. At USAA, we have an important mission: facilitating the financial security of millions of U.S. military members and their families. Not all of our employees... 

Mangrum Career Solutions LLC

Commercial Title Insurance Underwriting Counsel Attorney - Hybrid (Miami) Job at Mangrum Career Solutions LLC

 ...transactions. This role is ideal for a commercial real estate attorney or experienced title insurance underwriter who enjoys applying legal analysis to real estate matters, solving problems in real time, and partnering with internal teams and clients to deliver best-in-... 

AIG

Financial, Planning & Analysis Senior Analyst - Finance Operations Job at AIG

Who we are American International Group, Inc. (AIG) is a leading global insurance organization. AIG member companies provide a wide range of property casualty insurance in approximately 70 countries and jurisdictions. These diverse offerings include products and ...

Visa

Sr. Financial Analyst Job at Visa

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect...