GCP Senior Data Engineer

GCP Senior Data Engineer

Role Name: GCP Senior Data Engineer Work Site: Canada - Remote Start Date: Immediate Availability

Role Summary

We are seeking a GCP Senior Data Engineer with strong expertise in cloud data engineering, distributed processing, and GCP data services. The role will focus on building and optimizing scalable ETL/ELT pipelines, managing data infrastructure, and supporting advanced analytics and ML use cases.

Key Responsibilities

• Build and optimize ETL/ELT pipelines using Dataflow (Apache Beam), Dataproc (Spark), Pub/Sub, and Cloud Functions.
• Architect and manage BigQuery, Cloud Storage, and Data Fusion for data ingestion, transformation, and storage.
• Implement data validation, lineage, and metadata management using tools such as Data Catalog and dbt .
• Optimize pipeline performance, query efficiency, and GCP costs , including partitioning and slot reservations.
• Establish and maintain CI/CD, Git, infrastructure-as-code, monitoring, and data engineering standards .
• Mentor junior engineers and conduct code reviews.
• Collaborate with data architects, data scientists, and analysts to deliver self-service data platforms.
• Support advanced analytics and machine learning use cases.
• Implement monitoring and operational visibility using Cloud Monitoring and Cloud Logging .

Required Skills

Technical

• Strong SQL and Python skills.
• Proficiency in Java/Scala .
• Experience with distributed systems including Spark and Apache Beam .

GCP

• Hands-on experience with: BigQuery
• Dataflow
• Dataproc
• Pub/Sub
• Composer (Airflow)
• Terraform

DevOps

• Experience with CI/CD, Git, and Infrastructure as Code .

Nice to Have

• GCP certifications, such as Professional Data Engineer .
• Experience with real-time data processing .
• Experience with Vertex AI .
• Multi-cloud environment experience.