Data Engineer with Python, DataBricks and Snowflake Job at Godspeed Workforce, Ontario, CA

RTdDZERBQ0hMR3NTeW1EeXo0dTlmWEZqQ2c9PQ==
  • Godspeed Workforce
  • Ontario, CA

Job Description

Job Title: Data Engineer with Python, DataBricks and Snowflake

Location: Montreal, QC or Mississauga, ON - Hybrid

No. of positions: 2

Exp: 8-14 years

willing to relocate to Mississauga or Montreal

Responsibilities

  • Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel; Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Need to have working knowledge of MS Azure configuration items with respect to Snowflake.
  • Developing EL pipelines in and out of data warehouse using combination of Data bricks, Python and Snow SQL.
  • Strong understanding or Snowflake on Azure Architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.
  • Developing scripts UNIX, Python etc. to Extract, Load and Transform data, as well as other utility functions.
  • Provide production support for Data Warehouse issues such data load problems, transformation translation problems
  • Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
  • Understanding data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Requirements:

  • Minimum 8 years of designing and implementing an operational production grade large-scale data solution on Microsoft Azure Snowflake Data Warehouse.
    • Including hands on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL
  • Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies
  • Excellent presentation and communication skills, both written and verbal, ability to problem solve and design in an environment with unclear requirements.

Job Tags

Relocation,

Similar Jobs

United States Fund for UNICEF

Senior Project Manager, Integrated Campaigns Job at United States Fund for UNICEF

 ...UNICEF USA advances the global mission of UNICEF by rallying the American public to support the worlds most vulnerable children....  ...Integrated Campaigns position will be instrumental in ensuring cross-channel and divisional strategic alignment for all Integrated campaigns... 

Bayer

Associate Engineer - QC Microbiology - Indianola, PA Job at Bayer

 ...At Bayer were visionaries, driven to solve the worlds toughest challenges and striving for a world where 'Health for all Hunger for none is no longer a dream, but a real possibility. Were doing it with energy, curiosity and sheer dedication, always learning from unique... 

UT Southwestern Medical Center

Associate Director of Research- Clinical Informatics Center [Req#: 906854, Position#: 130081] Job at UT Southwestern Medical Center

 ...Description Opportunity UT Southwestern invites applications for the Associate Director, Research, of the Clinical Informatics Center (CIC). This role offers an unparalleled opportunity to develop and lead a research program that operates at the intersection of... 

Indeck Energy Services

Power Plant Operator Job at Indeck Energy Services

 ...Energy Services is looking for an individual with combined cycle power plant experience to fill an immediate position. This position...  ...Energy has developed, financed, managed the construction, owned and operated numerous power generation facilities across the United States... 

USAA

Compliance Analyst Intermediate Job at USAA

Compliance Analyst Intermediate Location Hybrid remote in Plano, TX : Why USAA? Let's do something that really matters. At USAA, we have an important mission: facilitating the financial security of millions of U.S. military members and their families. Not all of our employees...