Azure Data Engineer

Persistent Systems logo

Persistent Systems

View Salaries, Reviews, and more  

Job Summary


Job Type
-

Seniority
Senior

Years of Experience
Information not provided

Tech Stacks
Python Scala SQL Spark Azure Databricks pySpark Azure Data Lake Factory ETL

Job Description

About Position


We are looking for a dynamic Azure Data Engineer with exposure and hands on exp on Azure Stack – Azure Data Factory, Databricks, Pyspark, Scala. Certified Databricks will be an added advantage.

Exp in healthcare & clinical domain is preferred and good to have.

Role: Azure Data Engineer

Location: All PSL Locations

Experience: 3 – 10 years

Job Type: FTE

What You'll Do


  • Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Databricks) and PySpark.
  • Build and maintain data pipelines to support large scale data management projects
  • Solid hands-on working experience in SQL and scripting.
  • Experience in any orchestration/workflow tools for scheduling pipelines
  • Utilize Python and Spark within Databricks notebooks for data processing and transformations.
  • Integrate and orchestrate data from various sources, ensuring data quality and accuracy.
  • Build reusable rules for Data Quality and required transformations.
  • Optimize data pipelines for performance and scalability.
  • Implement data governance and security measures to comply with regulations.
  • Maintain documentation of data pipelines and workflows for knowledge sharing.
  • Analyse the data quality, data governance, compliance, and other legal requirements on data storage


Expertise You'll Bring

  • Exposure and hands on exp on Azure Stack – Azure Data Factory, Databricks, Pyspark, Scala.
  • Certified Databricks will be an added advantage.
  • Exp in healthcare & clinical domain is preferred and good to have.
  • Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure data bricks, Python, Pyspark etc.
  • Solid hands-on working experience in SQL and scripting.
  • Experience in any orchestration/workflow tools for scheduling pipelines
  • Utilize Python and Spark within Databricks notebooks for data processing and transformations.
  • Sound knowledge on Data Ingestion and Integration, Data Transformation and Processing, Data Storage and Management, Data Warehousing, Data Modeling and Analysis, Real-time Data Processing, Data Governance and Security

Benefits


  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents


Our company fosters a values-driven and people-centric work environment that enables our employees to:


  • Accelerate growth, both professionally and personally
  • Impact the world in powerful, positive ways, using the latest technologies
  • Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
  • Unlock global opportunities to work and learn with the industry’s best

Let’s unleash your full potential at Persistent

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”


Interview Questions of Azure Data Engineer at Persistent Systems

Interview questions from Persistent Systems that are similar to Azure Data Engineer
View more interview questions from Persistent Systems →
banner icon
Prepare For Your Interview in 1 Week?
Equip yourself with possible questions that interviewers might ask you, based on your work experience and job description.
Get Started!

Salary Insights of Azure Data Engineer at Persistent Systems

Currently, there aren't any salaries for this role at Persistent Systems shared by other job seekers.

View more salaries from Persistent Systems →

Achieve your dream job with our top-notch tools!

Resume Checker Illustration

Resume Checker

Our free resume checker analyzes the job description and identifies important keywords and skills missing from your resume in just a minute!

Check Now
Interview Preparation Illustration

AI InterviewPrep

Utilizing advanced AI, our tool generates tailored interview questions based on your industry, role, and experience. Practice and receive feedback on your answers in real time!

Check Now
Resume Builder Illustration

Resume Builder

Let us show you the differences between a bad, good, and great resume, and guide you in building a resume that helps you stand out to employers, ensuring you land your next position faster!

Check Now