Senior Azure Databricks Developer Job at Siri InfoSolutions Inc, Chicago, IL

RUxtYUNRV0JKR3dXdzJIenlvMjZmM0ZyQ2c9PQ==
  • Siri InfoSolutions Inc
  • Chicago, IL

Job Description

Title: Senior Azure Databricks Developer

Duration: Fulltime Permanent Hire
Location : Chicago IL

Job Description

  • Overall 10 years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystems
  • Experience in developing Spark applications using sparkSQL in Databricks for data extraction transformation and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns
  • Extract transform and load from sources system to Azure Data Storage services using a combination of Azure Data factory TSQL Pyspark and USQL Axure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake Azure Storage Azure SQL Azure DW) and processing the data in Azure Databricks
  • Hands on experience on developing SQL scripts for automation
  • Extensive handson experience implementing Lake house architecture using Data bricks Data Engineering platform SQL Analytics Delta Lake and Unity Catalog
  • Good understanding of spark architecture with Databricks structured streaming setting up Azure with Databricks managing clusters in Databricks
  • Excellent interpersonal verbal and written communication skills
  • Bachelors degree or equivalent work experience

  • Responsible for estimating the cluster size monitoring and troubleshooting of spark databrick cluster
  • Drive analysis architecture design governance and development of data warehouse data lake and business intelligence solutions
  • Research synthesize recommend and select technical approaches for solving difficult migration development and integration problems
  • Conduct and support workshops design sessions and project meetings as needed playing a key role in client relations
  • Develop and optimize ETL processes using Databricks and related tools like Apache Spark
  • Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory Event Hub etc
  • Experience working in agile development projects and sprint deliver

Job Tags

Permanent employment, Full time, Work experience placement,

Similar Jobs

Gpac

Construction Traveling Superintendent Job at Gpac

A nationally respected General Contractor is seeking a Traveling Superintendent to join their growing team! They have a backlog of projects across...  ...facing as well as have a thorough knowledge in commercial construction processes. Although their projects have grown in size and... 

Arlo Technologies, Inc.

Remote Senior Stock Plan & Payroll Administrator (Contract) Job at Arlo Technologies, Inc.

A technology solutions firm is seeking a Senior Stock Plan and Payroll Administrator to manage equity programs and ensure compliance with payroll regulations. This 1-year contract role involves coordination with cross-functional teams and preparing regulatory reports.... 

Schnitzer Family Campus - Mittleman Jewish Community Center ...

Lifeguard Job at Schnitzer Family Campus - Mittleman Jewish Community Center ...

 ...team! We are hiring lifeguards of all ages for year-round midday, afternoon, and evening shifts. Training shifts for current American Red Cross-certified lifeguards can begin immediately upon hire. PAY RATE: $17.35-18.88/hour; or $18.67 - $19.70/hour if also teaching... 

Carquest Auto Parts

Auto Parts Counter Pro Job at Carquest Auto Parts

 ...Genden Auto Parts is a family-owned and operated business, offers flexible working hours and supports growth opportunities throughout the company. We are seeking an experienced Auto Parts Counter Pro to join our team. As an Auto Parts Counter Pro, you will be responsible... 

Pierce Technology Corp

Low Voltage Cable Technician Job at Pierce Technology Corp

 ...completion of any local work, the ability to travel nationally is expected. Install and maintain low voltage cabling systems for telecommunications and data networks. Utilize hand tools and computer hardware to troubleshoot and repair network issues. Provide...