Data Engineer with Python, DataBricks and Snowflake Job at Godspeed Workforce, Ontario, CA

RTdDZERBQ0hMR3NTeW1EeXo0dTlmWEZqQ2c9PQ==
  • Godspeed Workforce
  • Ontario, CA

Job Description

Job Title: Data Engineer with Python, DataBricks and Snowflake

Location: Montreal, QC or Mississauga, ON - Hybrid

No. of positions: 2

Exp: 8-14 years

willing to relocate to Mississauga or Montreal

Responsibilities

  • Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel; Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Need to have working knowledge of MS Azure configuration items with respect to Snowflake.
  • Developing EL pipelines in and out of data warehouse using combination of Data bricks, Python and Snow SQL.
  • Strong understanding or Snowflake on Azure Architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.
  • Developing scripts UNIX, Python etc. to Extract, Load and Transform data, as well as other utility functions.
  • Provide production support for Data Warehouse issues such data load problems, transformation translation problems
  • Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
  • Understanding data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Requirements:

  • Minimum 8 years of designing and implementing an operational production grade large-scale data solution on Microsoft Azure Snowflake Data Warehouse.
    • Including hands on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL
  • Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies
  • Excellent presentation and communication skills, both written and verbal, ability to problem solve and design in an environment with unclear requirements.

Job Tags

Relocation,

Similar Jobs

Erico Technologies LLC

Remote Data Entry Clerk Job at Erico Technologies LLC

 ...Job Title: Remote Data Entry Clerk Company: Erico Technologies LLC Employment Type: Full-Time or Part-Time Location: Remote (USA) Pay Rate: $18-$26 per hour Overview: Erico Technologies LLC is looking for a dependable and detail-oriented... 

AIG

Finance Operations Analyst Job at AIG

Who we are American International Group, Inc. (AIG) is a leading global insurance organization. Building on 100 years of experience, today AIG member companies provide a wide range of property casualty insurance, life insurance, retirement solutions, and other financial...

Bayer

Associate Engineer - QC Microbiology - Indianola, PA Job at Bayer

 ...At Bayer were visionaries, driven to solve the worlds toughest challenges and striving for a world where 'Health for all Hunger for none is no longer a dream, but a real possibility. Were doing it with energy, curiosity and sheer dedication, always learning from unique... 

SURGE Staffing

Forklift, Tow, Clamp & Reach Truck Oper. Stand/Sit Job at SURGE Staffing

 ...Position Summary We are seeking a dependable and safety-focused Forklift Operator / Material Handler to support daily warehouse...  ...Operate forklifts and material handling equipment (sit-down, stand-up, reach truck, pallet jack, as applicable) in a safe and efficient manner... 

City and County of San Francisco

Transit Power Line Worker - SF Municipal Transportation Agency Job at City and County of San Francisco

 ...line work in the installation, maintenance, and repair of transit power systems including trolley overhead contact wires, poles,...  ...weather; may be required to work overtime; this is a 7 day / 24 hour operation. Qualifications Education : Completion of a State...