Senior Data Engineer

EXL logo

EXL

View Salaries, Reviews, and more  

Job Description

Responsibilities:

Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.

  • Create the data integration and data diagram documentation.

  • Lead the data validation, UAT and regression test for new data asset creation.

  • Create and maintain data models, including schema design and optimization.

  • Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.

  • Qualifications and Skills:

    • Strong knowledge on Python and Pyspark
    • Expectation is to have ability to write Pyspark scripts for developing data workflows.
    • Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum
    • Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.
    • Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.
    • Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.
    • Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.
    • Expectation is to have strong problem-solving and troubleshooting skills.
    • Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.
    • Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.
    • 5-7 years of experience in Data Engineer.
    • Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL.
    • Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks.
    • Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.

  • Interview Questions of Senior Data Engineer at EXL

    Interview questions from EXL that are similar to Senior Data Engineer
    View more interview questions from EXL โ†’
    banner icon
    Prepare For Your Interview in 1 Week?
    Equip yourself with possible questions that interviewers might ask you, based on your work experience and job description.
    Get Started!

    Salary Insights of Senior Data Engineer at EXL

    Currently, there aren't any salaries for this role at EXL shared by other job seekers.

    View more salaries from EXL โ†’

    Achieve your dream job with our top-notch tools!

    Resume Checker Illustration

    Resume Checker

    Our free resume checker analyzes the job description and identifies important keywords and skills missing from your resume in just a minute!

    Check Now
    Interview Preparation Illustration

    AI InterviewPrep

    Utilizing advanced AI, our tool generates tailored interview questions based on your industry, role, and experience. Practice and receive feedback on your answers in real time!

    Check Now
    Resume Builder Illustration

    Resume Builder

    Let us show you the differences between a bad, good, and great resume, and guide you in building a resume that helps you stand out to employers, ensuring you land your next position faster!

    Check Now