Senior Azure Databricks Developer Job at Siri InfoSolutions Inc, Chicago, IL

RUxtYUNRV0JKR3dXdzJIenlvMjZmM0ZyQ2c9PQ==
  • Siri InfoSolutions Inc
  • Chicago, IL

Job Description

Title: Senior Azure Databricks Developer

Duration: Fulltime Permanent Hire
Location : Chicago IL

Job Description

  • Overall 10 years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystems
  • Experience in developing Spark applications using sparkSQL in Databricks for data extraction transformation and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns
  • Extract transform and load from sources system to Azure Data Storage services using a combination of Azure Data factory TSQL Pyspark and USQL Axure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake Azure Storage Azure SQL Azure DW) and processing the data in Azure Databricks
  • Hands on experience on developing SQL scripts for automation
  • Extensive handson experience implementing Lake house architecture using Data bricks Data Engineering platform SQL Analytics Delta Lake and Unity Catalog
  • Good understanding of spark architecture with Databricks structured streaming setting up Azure with Databricks managing clusters in Databricks
  • Excellent interpersonal verbal and written communication skills
  • Bachelors degree or equivalent work experience

  • Responsible for estimating the cluster size monitoring and troubleshooting of spark databrick cluster
  • Drive analysis architecture design governance and development of data warehouse data lake and business intelligence solutions
  • Research synthesize recommend and select technical approaches for solving difficult migration development and integration problems
  • Conduct and support workshops design sessions and project meetings as needed playing a key role in client relations
  • Develop and optimize ETL processes using Databricks and related tools like Apache Spark
  • Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory Event Hub etc
  • Experience working in agile development projects and sprint deliver

Job Tags

Permanent employment, Full time, Work experience placement,

Similar Jobs

Reddit

Software Engineering Manager, Ads Creative Management Job at Reddit

 ...Reddit is a community of communities. Its built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+... 

International Health and Medical Services

Licensed Clinical Social Worker Job at International Health and Medical Services

 ...International Health and Medical Services delivers customized medical and security risk management and wellbeing solutions to enable...  ...is looking for an experienced licensed independent clinical social worker who serves as a subject matter expert (SME) in mental health... 

Figma

Data Science Intern (2026) Job at Figma

 ...from anywhere in the world. If you're excited to shape the future of design and collaboration, join us! Were looking for Data Science Interns who are excited to use data to answer big questions and guide decisions across Figma. At Figma, interns are embedded into small... 

Gas Field Specialists

Laborer- Oil and Gas Industry Job at Gas Field Specialists

Gas Field Specialists, Inc. is an independent gas service company with offices located in New York and Pennsylvania. Exemplary customer...  ...work out of town every other week, overtime and weekends. Gas and Oil experience prefered, though not required as we'll provide training... 

MetLife

RN - Clinical Support Consultant Job at MetLife

 ...potential functional abilities and develops goal-focused return-to-work plan. Assess training needs and creates, authors and...  ...accommodation due to a disability, please email us at accommodations@metlife.com. This information will be held in confidence and used only...