Senior Data Engineer - Azure Data Factory (ADF), Databricks

Job description:

Job Summary The Senior Developer will be responsible for overseeing the development and implementation of solutions using Snowflake, Azure Data Factory (ADF), and Data Bricks. They will play a key role in coding, testing, and deploying data solutions to meet business needs efficiently. Key Responsibilities 1. Developing, and maintaining scalable data pipelines using snowflake, azure data factory (adf), and data bricks.
2. Collaborating with stakeholders to gather requirements and understand business needs for data processing and analysis.
3. Optimizing and tuning data solutions to ensure high performance and reliability.
4. Implementing data security measures and best practices to protect sensitive information.
5. Troubleshooting and debugging data pipelines and resolving issues in a timely manner.
6. Keeping uptodate with the latest trends and technologies in data engineering and recommending enhancements to existing systems. Skill Requirements 1. Proficiency in snowflake, azure data factory (adf), and data bricks for building and managing data pipelines.
2. Strong programming skills in languages like sql, python, or scala for data manipulation and transformation.
3. Experience with cloud platforms like azure for data storage, processing, and analytics.
4. Knowledge of data modeling, data warehousing concepts, and etl processes.
5. Good analytical and problem-solving abilities to identify and address data related issues.
6. Good communication skills to collaborate with cross functional teams and stakeholders effectively. Other Requirements 1.Snowflake SnowPro Core Certification, Microsoft Certified1.Azure Data Engineer Associate.