Job Description

Title: Senior Azure Databricks Developer

Duration: Fulltime Permanent Hire
Location : Chicago IL

Job Description

Overall 10 years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystems
Experience in developing Spark applications using sparkSQL in Databricks for data extraction transformation and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns
Extract transform and load from sources system to Azure Data Storage services using a combination of Azure Data factory TSQL Pyspark and USQL Axure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake Azure Storage Azure SQL Azure DW) and processing the data in Azure Databricks
Hands on experience on developing SQL scripts for automation
Extensive handson experience implementing Lake house architecture using Data bricks Data Engineering platform SQL Analytics Delta Lake and Unity Catalog
Good understanding of spark architecture with Databricks structured streaming setting up Azure with Databricks managing clusters in Databricks
Excellent interpersonal verbal and written communication skills
Bachelors degree or equivalent work experience

Responsible for estimating the cluster size monitoring and troubleshooting of spark databrick cluster
Drive analysis architecture design governance and development of data warehouse data lake and business intelligence solutions
Research synthesize recommend and select technical approaches for solving difficult migration development and integration problems
Conduct and support workshops design sessions and project meetings as needed playing a key role in client relations
Develop and optimize ETL processes using Databricks and related tools like Apache Spark
Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory Event Hub etc
Experience working in agile development projects and sprint deliver

Job Tags

Permanent employment, Full time, Work experience placement,

Similar Jobs

The Odeon

Host Job at The Odeon

We are hiring hosts. We are looking for presentable, friendly, organized people to help greet, seat and assist the Manager on Duty. If this is you, please come by with your resume, Monday - Friday, 12 noon to 5 pm. We look forward to meeting you. The Odeon

Steris Corporation

On-site Medical Equipment Service Technician Job at Steris Corporation

...At STERIS, we help our Customers create a healthier and safer world by providing innovative healthcare and life science product and service solutions around the globe. Are you mechanically inclined with a knack for hands-on work? Do you enjoy a flexible schedule and...

American Driver

CDL A Regional Dry Van Driver - Home Weekly - $1,600+/Wk - No Touch Freight Job at American Driver

...max 1 preventable accident/2 yrs, ~ No SAP/failed tests)~ Stable history (4 jobs/12 mo, no safety terminations) Why drivers stay Same routes/customer/dispatchno surprises, freight always ready, phone answers every time. Hiring NOWnext class...

Amazon.com Services LLC

Lead Fulfillment Associate Job at Amazon.com Services LLC

...DESCRIPTION Lead Fulfillment Associate The Amazon operations team is looking for Lead Fulfillment Associates with a strong record of achieving results to join the expanding team supporting operations leaders and associates in delivering strong operations results...

Sephora

Beauty Advisor Job at Sephora

Sephora seeks a Part-Time Beauty Advisor in Washington DC to provide personalized beauty consultations and expert product recommendations. This role involves staying current with beauty trends, driving sales, and maintaining a welcoming store environment. Candidates should...

Senior Azure Databricks Developer Job at Siri InfoSolutions Inc, Chicago, IL

RUxtYUNRV0JKR3dXdzJIenlvMjZmM0ZyQ2c9PQ==