Data Platform Engineer

Job Title: Data Platform Engineer

Location: Pune

We are looking for a skilled Data Platform Engineer to design, build, and optimize scalable data platforms and pipelines. The ideal candidate will have strong expertise in Terraform, CI/CD, and DevOps practices across cloud platforms such as AWS and Snowflake.

This role requires hands-on experience in building data infrastructure while also maintaining and troubleshooting data pipelines using Python and SQL.

Key Responsibilities

• Platform Design & Development:
  Collaborate with the Data Tech Lead to architect and build next-generation data platforms using AWS and Snowflake.
  
• Infrastructure as Code (IaC):
  Design, implement, and manage infrastructure using Terraform to ensure automation, scalability, and reliability.
  
• CI/CD & DevOps:
  Build and manage CI/CD pipelines for data infrastructure using GitHub Actions, applying DevOps best practices across the lifecycle.
  
• Data Pipeline Engineering:
  Develop and maintain scalable ETL/ELT pipelines using Python, SQL, and orchestration tools such as Apache Airflow, dbt, or SQLMesh.
  
• Troubleshooting & Monitoring:
  Monitor and resolve issues in data pipelines, jobs, and cloud infrastructure to ensure high availability and SLA adherence.
  
• Performance & Cost Optimization:
  Optimize query performance, storage usage, and compute costs in Snowflake and AWS environments.
  
• Collaboration & Mentorship:
  Work closely with cross-functional teams, providing technical guidance and contributing to best practices.
  

Required Skills & Qualifications

• Strong experience with Snowflake (data platform and infrastructure components)
  
• Expertise in Terraform for Infrastructure as Code
  
• Hands-on experience with CI/CD pipelines and GitHub Actions
  
• Proficiency in Python and SQL
  
• Experience with Apache Airflow or Managed Airflow (MWAA)
  
• Knowledge of AWS services such as S3 and Lambda
  
• Familiarity with version control tools like GitHub
  
• Strong problem-solving skills and ability to work independently
  

Preferred Skills

• Experience with dbt or SQLMesh
  
• Exposure to large-scale data platform environments
  
• Understanding of data warehousing and modern data stack