Data Engineer with Python, DataBricks and Snowflake Job at Godspeed Workforce, Ontario, CA

RTdDZERBQ0hMR3NTeW1EeXo0dTlmWEZqQ2c9PQ==
  • Godspeed Workforce
  • Ontario, CA

Job Description

Job Title: Data Engineer with Python, DataBricks and Snowflake

Location: Montreal, QC or Mississauga, ON - Hybrid

No. of positions: 2

Exp: 8-14 years

willing to relocate to Mississauga or Montreal

Responsibilities

  • Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel; Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Need to have working knowledge of MS Azure configuration items with respect to Snowflake.
  • Developing EL pipelines in and out of data warehouse using combination of Data bricks, Python and Snow SQL.
  • Strong understanding or Snowflake on Azure Architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.
  • Developing scripts UNIX, Python etc. to Extract, Load and Transform data, as well as other utility functions.
  • Provide production support for Data Warehouse issues such data load problems, transformation translation problems
  • Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
  • Understanding data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Requirements:

  • Minimum 8 years of designing and implementing an operational production grade large-scale data solution on Microsoft Azure Snowflake Data Warehouse.
    • Including hands on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL
  • Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies
  • Excellent presentation and communication skills, both written and verbal, ability to problem solve and design in an environment with unclear requirements.

Job Tags

Relocation,

Similar Jobs

Ainsworth Inc

Chief Engineer Job at Ainsworth Inc

 ...strong employee engagement and a positive work environment that enables account retention. Qualifications First Class Stationary Engineer's Operating License and/or equivalent. CFC universal certification. Ten or more years of direct "hands-on" maintenance... 

Cigna

Home Infusion Nurse, Per Diem - Accredo - Rutland, VT Job at Cigna

 ...This position is anticipated to need around 5-15 hours per week. Home Infusion Registered Nurse Accredo Specialty Pharmacy Join Accredo...  ...techniques. Valid drivers license and ability to travel within a large geographic region. Ability to do multiple... 

CrowdStrike

Program Manager (Remote) Job at CrowdStrike

 ...fanatical commitment to the customer to join us in shaping the future of cybersecurity. Consistently recognized as a top workplace, CrowdStrike is committed to cultivating an inclusive, remote-first culture that offers people the autonomy and flexibility to balance the... 

Buzzi Unicem USA, Inc.

Environmental Engineer Job at Buzzi Unicem USA, Inc.

 ...role in meeting the current generation's needs, while preserving environmental quality and protecting the needs of future generations....  ...required, preferably in Environmental Engineering or related science At least 5 years experience in a regulatory, enforcement of... 

Department of State Hospitals

Clinical Social Worker, DCI Specialist - Social Work Services - Metropolitan State Hospital - 25-319 Job at Department of State Hospitals

 ...will run until filled with the following cutoff dates for review of applications: 1st and 15th of each month. Metropolitan State Hospital is located in the city of Norwalk. The Department of State Hospitals-Metropolitan is currently accepting applications for...