GCP Data Engineer + Orchestration

Skill: GCP Data Engineer + Orchestration

Experience: 5 to 8 years

Location: Pune/Hyderabad

Work Mode- Hybrid

Job Description:

We are looking for a skilled Data Engineer with strong experience in Google Cloud Platform (GCP) to design, develop, and maintain scalable data pipelines. The ideal candidate should have hands-on expertise in BigQuery, SQL, Python (PySpark), and workflow orchestration tools.

Key Responsibilities:

• Design, build, and optimize scalable data pipelines on GCP.
• Work with large datasets using BigQuery and ensure efficient data processing.
• Develop and maintain ETL/ELT pipelines using Python (PySpark).
• Implement and manage workflow orchestration using tools like Airflow or similar.
• Utilize GCP DataProc for distributed data processing.
• Write efficient and optimized SQL queries for data transformation and analysis.
• Collaborate with cross-functional teams including Data Analysts, Data Scientists, and stakeholders.
• Ensure data quality, integrity, and governance across systems.
• Monitor, troubleshoot, and optimize data workflows.

Mandatory Skills:

• Strong experience in Google Cloud Platform (GCP)
• Hands-on expertise in BigQuery
• Proficiency in SQL
• Strong programming skills in Python (PySpark)
• Experience with Airflow or any orchestration tools
• Experience with GCP DataProc

Good to Have:

• Experience with data warehousing concepts
• Knowledge of data modeling techniques
• Exposure to CI/CD pipelines
• Familiarity with other cloud platforms (AWS/Azure)