Sr. Hadoop Developer Job at Purple Fly Solutions, Delaware, OH

RkxDWENBdUVKbWdWem1IMHlZMjdkSFJrREE9PQ==
  • Purple Fly Solutions
  • Delaware, OH

Job Description

- Senior Hadoop Developer role based in Wilmington, Delaware, requiring in-office work.
- 1-year contract duration.
- Open for USC or GC Holders.
- Requires a minimum of 10 years of experience.
- Must be familiar with integrating data streaming platforms like Kafka for real-time data ingestion and processing.
- Should have at least 8 years of hands-on experience in the Hadoop ecosystem with expertise in PySpark.
- Proficiency in writing and optimizing complex Hive and Spark queries is mandatory.
- Experience in handling large volumes of data, especially in the banking domain, with a focus on data governance, security, and compliance is required.
- Must have strong Linux commands knowledge for file handling, process management, and system troubleshooting.
- Experience with Cloudera distribution including cluster management, troubleshooting, and performance tuning is necessary.
- Must have hands-on experience with Oozie for scheduling and managing complex ETL workflows and job orchestration.
- Ability to manage real-time data processing pipelines and large-scale financial data for critical business applications is essential.
- In-depth experience with Apache Spark distribution for high-performance distributed data processing, tuning, and optimization is required.
- A basic understanding of Hadoop administration tasks, including cluster monitoring, tuning, and troubleshooting familiarity in Ambari for cluster is mandatory.

Job Tags

Contract work,

Similar Jobs

Compass Group

Landmark Credit Union Live - Warehouse Picker/Runner Job at Compass Group

 ...uses Levy Purchasing systems (BOSS and more) Thoroughly completes all warehouse set-up and breakdown responsibilities Employs good safety and sanitation practices Practices proper product control and handling of all inventory and equipment Adheres to Levy Restaurants... 

Viaero Wireless

OSP Fiber Splicing Technician Job at Viaero Wireless

 ...The ideal candidates will be responsible for the splicing of new cable, testing, repair of existing cable, troubleshooting. Regional...  ...fiber plant. Drop burials. Dress and route fiber into data closets and work areas. Obtain and maintain company... 

Huron Regional Medical Center

Clinical Pharmacist Job at Huron Regional Medical Center

 ...Director of Pharmacy, following all policies and regulations, the pharmacist will be responsible for accurately interpreting orders,...  ...hospital and departmental safety policies and procedures, and state/federal regulations including USP 795 Non-sterile compounding, USP 797... 

Brandcoven

Call Center Representative I Job at Brandcoven

 ...Remote Call Center Representative Job Title: Customer Service Representative (Remote) Company: BrandCoven Location: Remote (Work from Home) Job Type: Full-time/Part time Brandcoven is a leading marketing agency that specializes in helping businesses build... 

SGS Consulting

Data Entry Clerk Job at SGS Consulting

 ...sorting information. Compile, verify accuracy, and sort paper-based data. Transfer paper-based data into electronic format in Microsoft Excel. Review data for deficiencies or errors, correct any incompatibilities. Maintain confidence by keeping information confidential...