Job Description

Description

We are seeking an experienced Google Cloud Data Engineer to join our team in New York, NY. The ideal candidate will have 10-15 years of extensive experience in data architecture, data ingestion, transformation, modeling, and analytics within the Google Cloud Platform (GCP). You will play a crucial role in designing and implementing scalable data solutions that enable our organization to leverage data for business insights and strategic decisions.

Responsibilities

• Design and implement scalable data ingestion pipelines using Cloud Dataflow, Pub/Sub, Datastream, or BigQuery Data Transfer Service.
• Migrate data from on-premises and other cloud platforms to GCP using Cloud Storage, Transfer Service, and BigQuery.
• Build and orchestrate ETL/ELT workflows using Cloud Composer (Airflow), Dataform, or Dataflow.
• Transform structured, semi-structured, and unstructured data into analytics-ready formats.
• Design efficient data models and partitioning strategies in BigQuery for high performance and cost optimization.
• Implement best practices for schema evolution, materialized views, clustering, and federated queries.
• Optimize BigQuery queries and pipelines for performance and cost.
• Implement monitoring and alerting using Cloud Monitoring, Cloud Logging, and Data Catalog.
• Enforce data governance, lineage, and security policies using IAM, Data Catalog, DLP API, and VPC Service Controls.
• Ensure compliance with enterprise security and privacy standards.

Requirements

• 10-15 years of experience in data engineering or related fields.
• Strong understanding of data architecture principles and best practices.
• Proficient in Google Cloud services including BigQuery, Cloud Dataflow, Cloud Storage, Cloud Composer (Airflow).
• Experience with data ingestion and migration tools like Pub/Sub, Datastream, and BigQuery Data Transfer Service.
• Expertise in ETL/ELT processes and data transformation techniques.
• Knowledge of data modeling and analytics best practices.
• Familiarity with data governance, lineage, and security policies in the cloud.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.

Job Tags

Similar Jobs