Data Engineer with Python, DataBricks and Snowflake Job at Godspeed Workforce, Ontario, CA

RTdDZERBQ0hMR3NTeW1EeXo0dTlmWEZqQ2c9PQ==
  • Godspeed Workforce
  • Ontario, CA

Job Description

Job Title: Data Engineer with Python, DataBricks and Snowflake

Location: Montreal, QC or Mississauga, ON - Hybrid

No. of positions: 2

Exp: 8-14 years

willing to relocate to Mississauga or Montreal

Responsibilities

  • Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel; Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Need to have working knowledge of MS Azure configuration items with respect to Snowflake.
  • Developing EL pipelines in and out of data warehouse using combination of Data bricks, Python and Snow SQL.
  • Strong understanding or Snowflake on Azure Architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.
  • Developing scripts UNIX, Python etc. to Extract, Load and Transform data, as well as other utility functions.
  • Provide production support for Data Warehouse issues such data load problems, transformation translation problems
  • Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
  • Understanding data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Requirements:

  • Minimum 8 years of designing and implementing an operational production grade large-scale data solution on Microsoft Azure Snowflake Data Warehouse.
    • Including hands on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL
  • Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies
  • Excellent presentation and communication skills, both written and verbal, ability to problem solve and design in an environment with unclear requirements.

Job Tags

Relocation,

Similar Jobs

UT Southwestern Medical Center

Associate Director of Research- Clinical Informatics Center [Req#: 906854, Position#: 130081] Job at UT Southwestern Medical Center

 ...Description Opportunity UT Southwestern invites applications for the Associate Director, Research, of the Clinical Informatics Center (CIC). This role offers an unparalleled opportunity to develop and lead a research program that operates at the intersection of... 

AIG

Financial, Planning & Analysis Senior Analyst - Finance Operations Job at AIG

Who we are American International Group, Inc. (AIG) is a leading global insurance organization. AIG member companies provide a wide range of property casualty insurance in approximately 70 countries and jurisdictions. These diverse offerings include products and ...

Bayer

Quality Generalist Job at Bayer

 ...At Bayer we're visionaries, driven to solve the world's toughest challenges and striving for a world where 'Health for all Hunger for none' is no longer a dream, but a real possibility. We're doing it with energy, curiosity and sheer dedication, always learning from unique... 

Duolingo

Motion Design Animator, Thrive Intern Job at Duolingo

Our mission at Duolingo is to develop the best education in the world and make it universally available. Its a big mission, and thats where you come in! At Duolingo, youll join a team that cares about educating our users, experimenting with big ideas, making fact-based...

Liberty Personnel Services, Inc.

Sales Engineer Job at Liberty Personnel Services, Inc.

 ...Job Details: Sales Engineer A client of ours is seeking an experienced Sales Engineer to support and grow an established industrial customer base in Illinois. This role focuses on developing long-term client relationships, identifying operational needs, and delivering...