Senior Azure Databricks Developer Job at Siri InfoSolutions Inc, Chicago, IL

RUxtYUNRV0JKR3dXdzJIenlvMjZmM0ZyQ2c9PQ==
  • Siri InfoSolutions Inc
  • Chicago, IL

Job Description

Title: Senior Azure Databricks Developer

Duration: Fulltime Permanent Hire
Location : Chicago IL

Job Description

  • Overall 10 years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystems
  • Experience in developing Spark applications using sparkSQL in Databricks for data extraction transformation and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns
  • Extract transform and load from sources system to Azure Data Storage services using a combination of Azure Data factory TSQL Pyspark and USQL Axure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake Azure Storage Azure SQL Azure DW) and processing the data in Azure Databricks
  • Hands on experience on developing SQL scripts for automation
  • Extensive handson experience implementing Lake house architecture using Data bricks Data Engineering platform SQL Analytics Delta Lake and Unity Catalog
  • Good understanding of spark architecture with Databricks structured streaming setting up Azure with Databricks managing clusters in Databricks
  • Excellent interpersonal verbal and written communication skills
  • Bachelors degree or equivalent work experience

  • Responsible for estimating the cluster size monitoring and troubleshooting of spark databrick cluster
  • Drive analysis architecture design governance and development of data warehouse data lake and business intelligence solutions
  • Research synthesize recommend and select technical approaches for solving difficult migration development and integration problems
  • Conduct and support workshops design sessions and project meetings as needed playing a key role in client relations
  • Develop and optimize ETL processes using Databricks and related tools like Apache Spark
  • Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory Event Hub etc
  • Experience working in agile development projects and sprint deliver

Job Tags

Permanent employment, Full time, Work experience placement,

Similar Jobs

OneSpaWorld

Acupuncturist Shipboard Job at OneSpaWorld

This is a International Shipboard Position on cruise ships The Company OneSpaWorld is a worldwide provider and innovator in the fields of beauty, wellness, rejuvenation and transformation across the globe on cruise ships and on land. The company is dedicated to maintaining...

Interim HealthCare - New Hampshire

Licensed Practical Nurse (LPN) School Nurse Job at Interim HealthCare - New Hampshire

LPN School Nurse Position!West Lebanon, NH Interim HealthCare is currently seeking a dedicated and compassionate Registered Nurse (RN) to provide specialized care to a high school young woman with seizures and a Gastrostomy Tube (G-Tube). The ideal candidate... 

MedConnect

Pediatric Neurologist Job at MedConnect

 ...Job Description The Department of Neurology is actively seeking a dedicated, full-time, board-certified/board-eligible Neurologist...  ...providing comprehensive evaluation, treatment, and follow-up care for pediatric neurology patients in both inpatient and outpatient settings.... 

All Star Healthcare Solutions

Neurological Surgeon - Locum Tenens in Florida for Neurosurgery ER Call Coverage Job at All Star Healthcare Solutions

 ...Handle both Spine and Cranial cases at a Level II Trauma Facility Qualifications: Board Eligible or Board Certified in Neurosurgery Valid medical license in Florida Excellent communication and interpersonal skills Benefits: Competitive daily rate with... 

Socotec

Building Envelope Engineering Inspector Job at Socotec

 ...engineering and construction industries focusing on high-performance buildings and specialty structures. Through an integrated, holistic...  ...Place to Work. Job Description As an Engineer Inspector, you will be joining a collaborative & mentorship-based team within...