Job Description

Title: Senior Azure Databricks Developer

Duration: Fulltime Permanent Hire
Location : Chicago IL

Job Description

Overall 10 years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystems
Experience in developing Spark applications using sparkSQL in Databricks for data extraction transformation and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns
Extract transform and load from sources system to Azure Data Storage services using a combination of Azure Data factory TSQL Pyspark and USQL Axure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake Azure Storage Azure SQL Azure DW) and processing the data in Azure Databricks
Hands on experience on developing SQL scripts for automation
Extensive handson experience implementing Lake house architecture using Data bricks Data Engineering platform SQL Analytics Delta Lake and Unity Catalog
Good understanding of spark architecture with Databricks structured streaming setting up Azure with Databricks managing clusters in Databricks
Excellent interpersonal verbal and written communication skills
Bachelors degree or equivalent work experience

Responsible for estimating the cluster size monitoring and troubleshooting of spark databrick cluster
Drive analysis architecture design governance and development of data warehouse data lake and business intelligence solutions
Research synthesize recommend and select technical approaches for solving difficult migration development and integration problems
Conduct and support workshops design sessions and project meetings as needed playing a key role in client relations
Develop and optimize ETL processes using Databricks and related tools like Apache Spark
Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory Event Hub etc
Experience working in agile development projects and sprint deliver

Job Tags

Permanent employment, Full time, Work experience placement,

Similar Jobs

NP Now

OB/GYN - Live in the Mountains! Job at NP Now

...Comprehensive benefits CME and Paid Time Off Residency Stipend! Student Loan Repayment: 50K over 5 years Visa Sponsorship if needed - J1 / H1B About the role: ~ Location: Taos, NM ~ Surrounded by the majestic Sangre de Cristo Mountains ~...

C&S Wholesale Grocers

Warehouse Order Selector - Freezer Job at C&S Wholesale Grocers

...to help feed local families, neighbors and communities. As a Warehouse Selector, youll pick, gather & organize product and prepare orders... ...Average Selectors earn $28.00+ per hour after training!~ Full Time, 1st shift ~ Freezer 8:00am start time and additional...

Animal Equality

COPYWRITER Job at Animal Equality

COPYWRITERTerms of Employment: Full-time, At-Will, Non-ExemptReports to: International Director of MarketingPosition Location: remote, US-basedPosition Objective:The Copywriter is a key member of Animal Equalitys marketing and communications teams that will...

Department of Industrial Relations

Court Reporter Job at Department of Industrial Relations

...Under direction of the Chief Hearing Reporter and Presiding Workers Compensation Judge... ...incidental related clerical and stenographic work. Effective July 1, 2025, specific Bargaining... ...team; Ability to tactfully interrupt court proceedings to clarify testimony;...

Atrium Hospitality

Breakfast Cook Job at Atrium Hospitality

**Hotel:**Hot Springs Embassy Suites400 Convention BoulevardHot Springs, AR 71901Breakfast CookPart time**Atrium SPIRIT - where teamwork, passion and appreciation ignite service excellence****What's in it for you?**The **Atrium SPIRIT** is a belief in the power...

Senior Azure Databricks Developer Job at Siri InfoSolutions Inc, Chicago, IL

RUxtYUNRV0JKR3dXdzJIenlvMjZmM0ZyQ2c9PQ==