GCP Senior Technical Specialist

GCP Senior Technical Specialist

Chennai, Tamil Nadu

Job Summary

• Experience: 5-10 Years

• Location: Bengaluru / Hyderabad / Chennai

• Employment Type: Full-Time

Role Overview

We are seeking an experienced GCP Data Engineer to design, develop, and optimize scalable cloud-native data platforms on Google Cloud Platform (GCP). The ideal candidate should have strong expertise in building batch and real-time data pipelines, data warehousing, ETL/ELT development, and cloud-based analytics solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using GCP services.
• Build and optimize data warehouses in BigQuery.
• Develop batch and streaming data processing solutions using Dataflow and Pub/Sub.
• Implement ELT/ETL pipelines using Python, SQL, and DBT.
• Create and manage workflow orchestration using Cloud Composer (Airflow).
• Develop data lake and data platform solutions using Google Cloud Storage (GCS).
• Perform data ingestion from multiple sources including databases, APIs, files, and cloud services.
• Optimize BigQuery performance through partitioning, clustering, and query tuning.
• Implement data quality, validation, monitoring, and governance controls.
• Collaborate with business analysts, architects, and stakeholders to understand requirements and deliver data solutions.
• Support production deployments and troubleshoot data pipeline issues.
• Follow Agile development practices and DevOps processes.

Mandatory Skills

• Google Cloud Platform (GCP)
• BigQuery
• Dataflow (Apache Beam)
• Cloud Composer / Apache Airflow
• Pub/Sub
• Google Cloud Storage (GCS)
• Python
• SQL
• ETL / ELT Development
• Data Warehousing

Key Responsibilities

1. Design, develop, and maintain google bigquery data pipelines for efficient data processing.

2. Utilize sql for querying and analyzing large datasets in google bigquery.

3. Develop and implement python scripts for automation and data manipulation tasks.

4. Create and optimize data processing pipelines using google dataflow.

5. Collaborate with stakeholders to understand data modeling requirements and utilize ca erwin data modeler for effective data modeling.

6. Monitor data quality, troubleshoot issues, and ensure data integrity across systems.

7. Stay updated with the latest technological advancements in data analytics and contribute to process improvements.

Skill Requirements

1. Proficiency in google bigquery for data warehousing and processing.

2. Strong command over sql for querying and analyzing datasets.

3. Advanced knowledge of python programming for data manipulation and automation.

4. Experience with google dataflow for building and optimizing data pipelines.

5. Familiarity with ca erwin data modeler for effective data modeling and database design.

6. Strong analytical and problem-solving skills to handle complex data related challenges.

7. Excellent communication skills to collaborate with cross functional teams and stakeholders effectively.

8. Ability to work in a fast paced environment and manage multiple priorities simultaneously.

Other Requirements