Senior Azure Databricks Developer Job at Siri InfoSolutions Inc, Chicago, IL

RUxtYUNRV0JKR3dXdzJIenlvMjZmM0ZyQ2c9PQ==
  • Siri InfoSolutions Inc
  • Chicago, IL

Job Description

Title: Senior Azure Databricks Developer

Duration: Fulltime Permanent Hire
Location : Chicago IL

Job Description

  • Overall 10 years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystems
  • Experience in developing Spark applications using sparkSQL in Databricks for data extraction transformation and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns
  • Extract transform and load from sources system to Azure Data Storage services using a combination of Azure Data factory TSQL Pyspark and USQL Axure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake Azure Storage Azure SQL Azure DW) and processing the data in Azure Databricks
  • Hands on experience on developing SQL scripts for automation
  • Extensive handson experience implementing Lake house architecture using Data bricks Data Engineering platform SQL Analytics Delta Lake and Unity Catalog
  • Good understanding of spark architecture with Databricks structured streaming setting up Azure with Databricks managing clusters in Databricks
  • Excellent interpersonal verbal and written communication skills
  • Bachelors degree or equivalent work experience

  • Responsible for estimating the cluster size monitoring and troubleshooting of spark databrick cluster
  • Drive analysis architecture design governance and development of data warehouse data lake and business intelligence solutions
  • Research synthesize recommend and select technical approaches for solving difficult migration development and integration problems
  • Conduct and support workshops design sessions and project meetings as needed playing a key role in client relations
  • Develop and optimize ETL processes using Databricks and related tools like Apache Spark
  • Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory Event Hub etc
  • Experience working in agile development projects and sprint deliver

Job Tags

Permanent employment, Full time, Work experience placement,

Similar Jobs

Tuscany Suites and Casino

Painter Job at Tuscany Suites and Casino

 ...ESSENTIAL DUTIES & RESPONSIBILITIES* Knowledge of practices, methods, tools and equipment used in preparing and applying paint to a wide variety of building, machinery and equipment surfaces.* Knowledge of techniques and principles of matching paint colors,... 

Family Service Rochester

Mental Health Practitioner Job at Family Service Rochester

 ...Family Service Rochester is seeking a Full-Time Mental Health Practitioner. This position provides skills-based training to youth, families, and/groups within Childrens Therapeutic Support Services (CTSS) program. CTSS services are designed to rehabilitate skills disrupted... 

Department of Rehabilitation

Support Services Assistant - General Job at Department of Rehabilitation

 ...This position is located in the city of San Jose . Under the direct supervision of the Rehabilitation Supervisor, the Support Services Assistant (SSA) is responsible for performing the following job functions: reading print material and computer screen as... 

Sales Match

Customer Support Representative Job at Sales Match

 ...dependable individuals to join our team as Remote Customer Support Representatives. In this role, youll work from home and help customers by phone, email, or chat, handling questions about orders, accounts, and general service information. Youll be the first point of... 

TekSynap

Unix Administrator Job at TekSynap

 ...Clearance**+ Secret - IT-I (Tier 5/SSBI) Critical Sensitive Clearance**Certifications**+ DoD 8570 IAT Level II Baseline Certification+ COMPTIA Security+ CE+ Cisco Certified Network Associate (CCNA)+ COMPTIA Cybersecurity Analyst (CySA+)+ Global Information Assurance...